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REPORT OP THE PANEL ON ECONOMICS TO 
THE SCIENCE INFORMATION COUNCIL 

DIGEST 

What Is at stake . Scientific and technical 
Information services cost the Federal government close to 
a billion dollars a year, and cost further large sums to 
non-Federal sectors of the economy. They undoubtedly deliver 
benefits of the same order as their cost, but unless the 
relation of benefit to cost Is quantitatively understood, 
there are dangers of enormous waste In some areas, or of tine 
passing up of enormous net benefits in others. (Section I) 

Issues needing economic .ludgments' . The information 
services for which sizable expenditures are made are very 
diverse (Section I.3 Fig. 1, Appendix A). They cover: written* 
oral, and photographic media; research results, secondary 
Information, evaluated information, and engineering data. 
They may be provided at the producer or the user end of the 
chain. There Is need for techniques of economic analysis 
applicable to as many of these services as possible. 

Factors In economic decisions; gaPP In our 
knowledge . For Intelligent declslon*making, a broad spectrum 
of factors need to be borne In mind^ extending from costs 
at the one end to quantified benefits at the other end^ 
and Including such Intermediate considerations as stability^ 
motivation, etc.* and also measures of performance In ^ 
non*monetary terms. (Section IIJ., Pig, 3») There Is a sizable 
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literature on the costs of Information services, and on the 
evaluation of their performance In various kinds of nondollar 
terms. (Sections II. 2, 30 Very little has so far been done 
toward the assignment of a monetary value to the benefits they 
deliver (Sections II. 2, 4, 5> 6). While some useful types of 
economic analysis can be made without such assignment (Section II,3)> | 
most economic decisions require a weighing of benefits against 
costs, and so require that benefits be quantified. Thus It Is 
this component of our understanding of economics that we feel 
Is most In need of attention now. 

Techniques for quantifying benefits . We feel 
that It should be possible to develop rough but useful 
quantitative measures for the benefits delivered by many kinds 
of Information services, by combining theoretical analysis 
with suitably gathered empirical data on the response of the 
user community to these or related services. Though It may In 
rare Instances be possible to get objective measures df benefits, 
or lower bounds to them (Section II. 4), In most cases the 
ultimate Judgment of value will have to come from the multitudes 
of users or purchasers of the services: these will usually have 
more expert and first-hand knowledge of the benefits delivered 
than anyone else, and reliance on the collective Judgments of 
many people Is a further safeguard. (See Section II#5)* However, 
these small*scale Judgments need to be corrected In several ways 
If they are to provide a measure of benefit to the whole society. 
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or even to a large organization! they are self-interest 

judgmentsi and do not usually take account of externalities, 

such as the benefit received by one person or a group through 

the ust> of an information service by another. To make such 

corrections it is necessary to construct reasonably adequate 

economic models and models of the way in which different channels 

for the communication of information interact. (Sections II. 7» 

% III.l, 2.) 

The two most useful sources ~of"'ih?ormat"ibn on,'- 

quantified Judgments of value by users are: 

(a) Market response* i.e., what usersj as individuals 

or through their organizations^ are willing 

to pay for an information product or service. 

Existing market data can, often j>rovide an 

adequate measure of' value for a hypothetical 

change that will ailter the price at which a 

given information service is marketed^ without 

altering its. characteristics. However, 

market data usually tell only the number 

buyers who assess the value of the prpduct 

at more than the offering price^ but do 

not give good information regarding how 

much more the value to certain buyers may be. 

Therefore such data are rather unsatisfactory 

for assigning monetary value toAtanges that 

will alter the nature of a product or service. 
(Sections II.5, III. 3* Appendix B.) 
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(b) Investment of time by Individual users > Each 

user of an information service derives benefits 

from It which Increase more and more slowly 

with increase In the amount of time he devotes 

to use of it. In practice he will try to devote"*^ 

only as much time to such use as will yield him 

more benefit than the same amount of time devoted 

to his ^ther activities »___fflus a knowledge of 
the investment of time by users provides "a 

measure of value; it must of course be calibrated' - 

from a knowledge of the dollar value -of' their 

time and corrected for externalities having to 

do with the avaliabillty of alternate channels 

for information. (Section II.6, Appendix D.) 

Sometimes opportunities can be found for checking 

the validity of the hypothesis that users 

allocate their time according to intelligent 

self-interest Judgments; whan the ass\Mption 

falls^ such failure can .to in t the way " to "much- 

heeded user education. Kreh in fiuch casedj a 

lower bound on the value of a service, or a 

changed in one/ may be obtainable* 

A number of examples are di'scui^sed (Section IV, 

Appendix E) showing how data of either the mirket-response 

or the user-time kind might be applied to assign a^ monetary 

benefit to each of a number of typical decisidns regarding an 
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Innovation in an Information service. These examples, though 

very sketchily discussed, make more explicit the kinds of 

empirical information about markets^ users, and the functioning 

of information channels, which would need to be fathered* 

Recommendations * (Section V,)" To obtain quantitative value 

measures by the techniques Just sketched, extensive data on 

the markets for Information serviced and oh the habits of 

their users will be needed^ as well as sophisticated theoretical 
analysis of markets and of the Interaction^pf^HfrFfent" modes 

of information transfer* Studies of all these types can 

appropriately be sponsored by OSISi and have indeed been so 

conducted in the past; howeveri what is needed now is a 

closer integration of theoretical and enq>irical studies^ so 

that theoretical models are constructed with due account of 

real-life circumstances, and so that "user studies" do 

indeed collect the kind of .data needed for quantification 

of value, and In particular -give adequate- attention to the 

interplay of different modes of information transfer* .In 

the course of such studies, any opportunities fbr evaluation 

of factors affecting the stisibllltyi continuity, and feasibilityi 

of information services should be identified and exploited* 

Acting through COSATIi OSIS should keep other agencies of 

the Federal government Informed of the state of development 

of techniques for quantification of benefits, and should 

assist them In making economic decisions on their information 

programs* To fulfill this role adequately, it- will need to 

develop substantial expertise oh information economics within 

its own staff* 
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I. INTBODUCTION 

1* Background 

The Federal government spends^ directly or 

through its contractors^ something like a billion dollars a 

year for the dissemination of sclentlf Icand technical Infprma-^ 

1 2 

tion, according to recent studies* ' Nongovernmental 
organizations spend further large sums for the same purpose* 
This Impressive total Is compounded of many diverse activities, 
each of >tfhlch Is presumably undertaken In the expectation 
that our society, or at least some component of It, will 
receive benefits greater than the expenditure Involved* To 
Justify such expectations one needs an at least roughly 
quantitative measure of benefits* Here_ la the difficulty* . 
It Is much harder to e:xpress In dollar terms the benefits 
provided by Information services than those resulting from 
most other activities. Yet without such quantification ope 
runs the risk of spending hundreds of millions of dollars 
wastefully or of commltlng the equally grievous sin of holding 
back on expenditures that could produce net benefits of this 
order or greater. 

Recognizing this need, and taking note of recent 
Innovative applications of operational reserach and economic 
theory to Information a ervlces, the Science Information Council 
at Its Pebruaiy 1971 meeting decided to set up a Panel on 
Economics from its membership, with a charge to consider the 
economic aspects of the role of government. In both its 
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operational and Its supportive functions, in the development ^ 

and operation of Information systems* The Panel, whose 

findings are described in the present report, has chosen to 

interpret this charge rather narrowly, in that it has devoted 

most of its attention to the question: Gould governmental or 

other agencies, that operate or directly or indirectly support 

information activitiesi get more value for their money with 

tne help of economic research in certain as yet unexploited 

areas? The conclusion will be that this is indeed the case^ 

and that the principal such areas meriting further study are 

those having to do with the assignment of a dollar value to 

the benefits derived from information activities* In the 

following paragraph^ and in more detail in Section II belowi 

we shall sketch how the quantification of value fits into the 

overall picture of infrrmation economics* and shall indicate 

why we feel that our concentration on this aspect is in accord 

with the motive of the Science Infomation Council in setting 

up the Panel. 

2. The competition between coata and benefits 

While the problem of economic management ia basically 
one of aubtracting coata from benefita to get net benefita, it 
haa many more ramification than are auperficially apparent in 
theae aimple terms. Some arbitrary deciaiona muat be made: 
Coata to whom? Benefita to whom? What thiAgs does one' include 
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as costs, rather than as detractors from benefits? Even for 

a well-defined operation, cost accounting Is a rather subtle 

sclencei Moreover, In mcmy cases one ought to take account 

of hidden costs to elements of society outside the organization 

performing the service* Sound economics In management Involves 

many further considerations: such things as stability In the 

face of fluctuations, motivations for good performance, 

political feasibility, etc* In the area of results, the easiest 

data to come by are usually performance measures that are only 

presumed to be related to benefits -* such things as volume and 

speed of publication (for primary literature), completeness 

and depth of Indexing (for secondary services)^ attendance (for 

meetings), etc* While one can sometimes make decisions that 

are obviously good In that they reduce costs without changing 

performance or Improve performance without changing costs, 

most decisions turn out to affect both costs and performance, 

and to make them wisely, one must make some sort of guess at 

the dollar value, to society as a whole or at least to some 

enterprise within It, of the benefit that the users of an 

Information service receive from It, 

While there Is an extensive literature on costs, 

and also on measures of performance for Information services, 

the literature on the quantification of benefits actually 

delivered Is extremely meager* There Is a gaping hole In our 

knowledge at this crucial point* It Is for this reason that 

we have given most of our attention to this topic; we shall 
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argue below that there Is hope for real progress on It. 
Besides this central concern, we shall have a few words to 
say on some hitherto overly-neglected aspects affecting the 
practicality of Information services; costs and perforroance, 
however, we shall not touch In any detail* 

3* Range of activities to which this Report Is addressed 

All these remarks have referred to Information serlvces 
In very general terms* Most of the conceptual framework we 
have sketched, and many of the Ideas to be developed In the 
body of this Report, could be applied to Information activities 
as diverse as schools, product advertising, public libraries, 
etc* Though such applications might be very Important, we 
have thought only In terms of scientific and technical Information 
activities, and In fact not quite all of these* But even so, 
the activities to which this Report Is addressed may be 
extremely diverse, and It will be Illuminating to examine this 
diversity and list of few typical examples of how decisions 
about Information services may depend upon the quantification 
of value In specific situations* 

Figure 1 essays to classify Information services 
according to the type of conmrunlcatlon and the Identity ot the 
performer; some eleven areas, covering the most Important 
types of Information activities, are Identified on the grid 
and will be used In our discussion and listing of examples* 
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(Editor, 
Publisher, 

etc) 



Infomatlon 
Center 



Local User 
Organization 



FUHLISHED 
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PUBLISHED 



Primary 

Journals 

Books 

Reports 
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Other 
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Books 

Coiqi nations 
Articles 
Technical Data 



Popular and 
pedagogical 



ORAL OR 
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C 



I; MEETINO SUPPORT 



WiM* ^* Mttjor categories of scientific and technical information services for which economic 
. nast. be aade - - - - - . . - - 



decisions 



See Appendix A for further discussion. 



Appendljc which the reader Is urged to consult at this 
polnti contains a few vords about the scale and economic 
Importance of each of the eleven areas, followed by one or 
more examples of decisions a governmental agency, a scientific 
society, or a research organization might have to make 
regarding the operation of some service of this type* For 
brevity we quote here only one example for each major category 
In Fig* 1, omitting categories H, J, and K: the list In 
Appendix A includes a few further examples* Our numbering 
here Is the same as that used there, hence the missing numbers: 
A, Technical libraries * 

(1) When should a university or. other research 
organization split off local departmental 
libraries from a centralized library? 
B* Systems for selective dissemination of Information and 
computerized services > 

(4) When should a research organization put 
Into operation a selectlve^dlssfimlnatlon 
system for its staff? 
C, Information-analysis centers * 

(6) When Is It worthwhile to start an Information- 
analysis center tn a new f l<&ld, or to significantly 
expand an existing center? 



D, Journal production , 

(8) When should a scientific society adopt a 
larger part format for Its Journals? 

E, Schemes for distribution for reports and preprints , 

(9) When, and on what scale, should preprint 
exchanges be subsidized? 

P, Abstracting and Indexing publications , 

(13) Should an abstract Journal computerize Its 
annual*lndex production to enable the Index 
to be produced more promptly? 

G, Review grants, etc , 

(14) Should an agency supporting research divert 
some of Its research funds to a program of 
grants to authors for the preparation of , 
reviews and cona>llatlons? 

I, Meeting support , 

(15) How much money should a research organization 
set aside for travel of Its staff members 

to meetings? 

4, Organization of the Report 

We shall return to a discussion of some of these - 
In Section IV, where we shall suggest ways of quantifying 
benefits for particular sample situations. We shall commence 
our report, however. In Section lit with a broader look at 
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the components entering into declslon*maklng regarding the 
economics of Information services, and a brief Indication. of 
how much Is-now known about them* Section III will elaborate 
on the prospects for Improving our knowledge at the pdlnts 
where It Is now most critically lacking* Section V, finally, 
will offer some recommendations for steps OSIS might take 
to facilitate more cost-effective decisions on Information 
services* 
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II* COMPONENTS OF THE PROBLEM, AND SOUBCES OF KNOWLEDGE 
ABOUT THEM 

!• Economic decisions; quantifiable factors, arbitrary 
definition^ and imponderables 

It will be well to commence our discussion with a 
brief elaboration of the remarks made in Section 1*2 above 
regarding the subtleties of the net^beneflt assessment* As 
Indicated there, one must first ask: net benefit to whom? 
A corporation may be Interested mainly In Its own profits, a 
scientific society mainly In Its membership, or perhaps the 
enterprises In which Its members work, etc. For at least some 
of the agencies of the Federal govemmentj the concern may be 
for the welfare of the whole lAilted States, We shall give 
especial attention to this case, while recognizing that it 
is by no means the only one of importance. Right now what we 
want to stress 1b merely that anyone making economic decisions 
must clearly Identify at the outset for what entity — we shall 
call It a "universe of concern" — he wants to know net benefit. 

Having identified this universe of concern, one 
must next decide how to define costs and benefits for It. The 
separation of costs from benefits Is purely a matter of convenience, 
as a cost can be regarded as a negative benefit, and vice versa* 
What one usually does Is exemplified by Fig* 2: One isolates, 
among the activities of the universe of concern, a fairly accurately 
monitorable subset associated with provision of an information 
service, such that the benefits attributable to these activities 
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HIDDEN 
COSTS 

\ (or peripheral 
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\ 



UNIVERSE OF 
CONCEBH 



Pig. 2. Separation of benefitfs from costs. (Costs^negatlve 
benefits,) Note that there is sc»ie arbitx^rlnesa-Ui 
the locations both of the outer boundary and of the 
Internal dividing lines. 
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alone are negative and appear In the accounts of some 
organizational entity as "costs"; these activities are 
represented by the sector at the top of the figure labeled 
"organization providing service," and the corresponding costs 
are the "recorded costs" of this organization. Next one 
identifies, again In the same universe* a "user coimnunltyi " 
or more properly, a complex of use activities* through which 
the principal benefits of the service are delivered; These 
benefits* unlike the costs Just mentioned, will usually not 
be available In the form of raw monetary records* but will 
have to be evaluated by a special effort. What one must 
realize Is that the dividing line between production (costs) 
and utilization (benefits) Is somewhat arbitrary* and may be 
chosen differently In different approaches to the economic 
analysis of a given situation* For excocple* If one tries to 
measure the benefits provided by a scientific Journal from data . 
on how much Its purchasers are willing to pay for It* one vlll 
Include In the costs only the production cost proper; but if 
one approaches benefits from the amount of time users sp«nd 
reading It* one should Include on the cost side such things as 
library storage costs, xeroxing costs* etc. For a given universe 
of concern the net benefit will not depend on wh«re the dividing 
line is drawn* but the partitioning into "costs" «id "benefits" 
will* 



20 



- 12 - 



After all this has been done there may or may not 
remain, within the universe of concern, other groups or 
activities for or through which other advantages or disadvantages 
accrue, less subject to direct observation than the recorded 
costs and direct benefits Just mentioned, but still deserving 
some consideration in decisions # For example, producing a 
scientific Journal entails a cost to the scientific community 
which does not appear on the books of the Journal, namely, the 
time invested by referees; similarly, the practice of publishing 
articles not only provides information to readers, but motivates 
authors to complete their work* Such hidden costs or peripheral 
benefits are shown at the lower left of the figure* ^ ' 

We have so far been talking about the information 
service and its use as if they were static, in a uniform steady 
state* But real life is full of fluctuations, innovations, and 
secular trends* Economic decisions, like any others, must allow 
for foreseeable changes and preserve options for dealling with 
the unforeseeable* Changing .circumstances can sometimes be 
allowed for in a quite quantitative way, as when one amortizes 
a developmental cost or a capital investment* But even in such 
cases an assessment of net benefit must refer to a specific 
period of years , the duration of which is choseh' sottiewhati 
arbitrarily by the planner* Slightly harder to reduce to numbers, 
though basically amendable to orderly planning, is the que^*;ion 
of how much extra cost is incurred, or how much utility Idst, 



when basically desirable changes are made too suddenly* 
Other factors having to do with adaptability to changes are 
still more difficult to quantify: What Is the value of 
stability with respect to unforeseen fluctuations In user 
dem«id> In unit costs. In amount or kind of information to be 
handled, etc.? Will the motivation for wise or efficient 
decisions by the operators of an Information service be Improved 
or dampened by a given change In Its mode of operation or 
support? Finally there Is always the question: can one win 
the sup^port of the people whose cooperation Is needed In order 
for an enterprise to work? 

Plp^ire 3 summarizes the factors we have mentioned 
as Important for economic decisions, and lists various types 
of decisions to which they must be applied* (It Is Interesting 
to note that the categories used in this figure have been used 
Independently by others;*^' thus our first, third, and fourth 
columns are essentially what are called **cost," "effectiveness/' 
and *^ benefits" in the opening chapter of the book by King and 
Bryant"^*) Although all the columns of Pig* 3 are Important, 
this Report will give most of Its attention to the topics that 
have been least adequately dealt with In previous economic 
studies* As we shall see presently, these are the two entries ' 
encircled by the full line in the column "quamtlfled benefits"; 
we shall discuss their nature^ cmd the distinction between them. 
In Item ^ below* Our recommendations, given in Section V, will 
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DECISIONS DETERMINED BY SUCH ANALYSIS: 

Inaugurate? 
Close dovm? 
Modify? 

Pricing and promotion 
Subsidy? 



Fig. 3. Components of economic deciBion-makiiig. about 
information services. The full and -dashed 
contours identify the major and subsidiary 
concerns J respectively, of the present. Report. 
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deal largely with these topics, but will also touch on the 
entries "stability" and "motivation," and "objective methods" 
which are accordingly encircled with dashed lines* 

2* The diversity of perspectives on Information economics 

One of our first objectives should be to survey 
the thinking that has been done to date on the economics of 
Information services, and to Identify gaps, limitations, and 
areas of progress* We shall do this only rather sketchlly In 
the following paragraphs, mentioning only some of the highlights 
of the literature of the subject, and deferring until later 
sections the discussion of what It has had to say on certain 
specific topics* 

The economics community, whose expertise Is obviously 
greatly needed, has^only rarely given any attention to Infonaa* 
tlon services* Machlup's famous book,^ though full of sound 
philosophy and economic statistics about Information for the*- 
public and the economy as a whole, covers so broad a territory 
that scientific and technical Information services get lost* 
On a much smaller scale, there Is a thought-provoking 1968 
lecture by Marschak,^ which essays a very broad-brush look at 
certain Issues froiji an economist's point of view* He approaches 
the role of information by distinguishing the three functions 
of Inquiring, communicating, and deciding; he points out that 
the discipline of communication theory telescopes the first 
and third of these to concentrate on the second, while 



24 



- 16- 



the discipline of statistical decision theory telescopes 

for communication link. He also calls attention to the 

Importance of the "problem of optimal assortment" — the tying 

together of services aimed at different desiderata Into a 

package which, though not optimum for any single user> may 

be economically favorable for the community. But from the 

paucity of economic studies mentioned by Marschak> and their 

specialized nature. It Is natural to Infer that not much work 

relevant to Information services has been done. 

Fairly recently a few more ej^llclt attempts have 

been made by economists to deal with some of the problems of 

Information services, A study*^ done for OSIS by a group at 

Mathematlca> Inc,> under the direction of W, J, Baumoly h&s. 

shown how a number of basic principles and methodologies of ' 

economics apply to some kinds of Information services, discussing 

such things as ejctemalltles> optimal prlclng> subsldles> 

economies of scale> and mathematical modeling. We shall discuss 

specific points In this report In various places below. In 

general the treatment Is rather abstract> and Is admittedly 

preliminary, not yet Incorporating many Ideas from the communities 

of Information managers. Information scientists, or users, 

8 

Also worth noting are some studies by Berg of the 
economics of scientific journals. These again are formulated 
In the framework of an Idealized economic model; hoWever, some 
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fairly detailed analyses of price elasticity of demand, etc,> 

are given for specific Journals, 

Though not specifically applied to Information 

g 

services* the work of Becker-^ on people's time as an economic 
variable Is of considerable potential Importance for them. 
We shall use some related concepts In Section III. 4. In a 
more philosophical than economic conteJct> Slmon^^ has also 
stressed the value of people's tljne> and the Importance of 
conserving It. 

When Information scientists and Information managers 
approach economic problems> they are apt to be most Interested 
In the costs of their systems and In nondollar measures of 
their performance* These traits are manifested In many studies 
(mostly unpublished reports) discussed In the chapters entitled 
^'Design an<$ Evaluation of Information Systems*' of the series 
Annual Review of Information Science and Technology . A large 
and coherent group of such studle.s> performed by Vestat> Inc. 
for OSIS> has been brought together and expanded In the book 
of King and Bryant>^ which gives an ejccellent discussion of 
many aspects of cost analysis and especially performance 
evaluation for document transfer systems. Though It gives a 
brief discussion of economic mcdeling> this book has little to 
say on ways for determining the coefficients relating benefits 
to measures of performance. Similar comments could be applied 
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to many other^ more specialized^ discussions in the Information* 
science literature^ some of lAilch we shall cite In the sections 
to follow* 

The user community has contributed to thinking on 

Information economics only in those rare Instances where aome 

of Its members have temporarily assumed roles as Information 

scientists or information managers; thus their contributions 

are not sharply distinguishable from the cate®Dry Just discussed* 

An example that Is clearly part of the Information-science 

12 

literature Is a book by Morse which shows how operational- 
research techniques can be employed in , library mana|[ement^. though 
It says little about such central economic Issues ae the 
quantification of benefits* Typical of comprehensive uaer-orlented 
studies of information problems 1b the SATCOM Beport^^^ Which 
calls attention to the great need for In^roved underetuidlng of 
the economics of information services^ but contribute^; no 
explicit suggestions* More explicit economic statistics^ cmd' 
an attempt at economic modeling and rough quantlf Icatjlon of 
benef its, are contained In a SKSCOH task group report on pi;lmieLxy 
Journals. Still another type of attack on the econcmlcB of 

Information services* based on user surveys* Is represented by 

15 

A Qtudy made by a commltte of the American Chemical Society* 

In which time spent by chemists in the .use of , information resources 

and time saved by the use of certain services Is estimated. 



27 



- 19- 



We shall dlecuss some of the Ideas of these latter two studies 
in Items 4 to 6 below, 

3- Costsj perfomance^ and analyses using these alone 

We are now ready to start discussing the various 
areas In the table at the top of Fig* 3. From the brief 
survey of types of literature we have Just given In Item 2^ 
It Is clear that existing studies have treated costs and 
performance far more adequately than the other Items* So It 
Is appropriate for us to begin with a few words about the state 
of our Knowledge of how to treat these two factors^ and what 
can be done with them aXone^ without having to convert performa>ce 
Into something with a definite dollar value* 

As has already been hinted^ costs are of many types* 
Some are transient^ and must be amortized over a suitable 
period; these include developmental costs^ Initial promotion^ 
capital equipment^ etc* For some one^shot activities (e*^*^ a 
special conference)^ all costs are transient. But most 
information seri'^lces do have a more or less steady^state 
operation^ and here It Is Importcmt to dlsttngulbh those costs 
that depend mainly on the supply of information to be processed 
from those that are roughly proportional to the number of users 
of the service* In the familiar case of scientific Journal 
publication^ these two categories are represented respectively 
by the editorial uid coir^osltlon (pre*run) and the printing 
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and mailing (run-off) costs, There are also steady-state 

promotional and marketing activities. More subtle^ but often 

very important, are the hidden costs: their magnitude may 

be very dependent on where one chooses the boundary of the 

"universe of concern" in Fig, 2, From a broad social point 

of view, referees* time and other donated services, authors* 

time, readers* time, travel time, costs of storage space, etc, 

should often be taken Into account. 

As we have noted earlier, the literature on costs 

of Information services is fairly extensive,- Annuajl surveys 

of it can befcund In the chapter of Annual Review of Information 

Science and Technology entitled "Design and Evaluation of.,, 

Information Systems" a modest minority of th^ , one .or tiyo . * , 

hundred references cited each year pertain to costing, Th? , 

book of King and Bryant^ discusses the subtleties, of cost, ^ 

analysis in some detail, especially in Chapter 3, The SATQpM 

Task Group Report contains much Information on both recorded 

costs and hidden costs for primary Journals, Further samples^ 

of the literature on costing are provided by papers of Hurdock 

'and Llston^ (retrieval systems), and of Landau^*^ (bibliography 

on costs of doc ument-sur rogation systems), and by a recent 

l8 

review by Penner, Though often disregarded, secular trends In 
costs can be very important. The causes and Implications of s]uch 
trends are discussed In Section V of the Mathematlca study,*^ 

Probably the most extensively studied of the 
elements listed In Fig, 3 are those subsxMed under the word 
"performance," Thus, a large part of the book of King and 
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Bryant, much of Lancaster's book " and a large portion of 
the references In the annual "Design and Evaluation" reviews, 
have to do with the design and use of measures of performance, 

20 

usually for document- transfer or retrieval systems. Henderson 
has given a bibliography of the older literature. Typical 
examples of what we call performance measures for retrieval 
systems are speed, completeness, and percentage of retrieved 
items found relevant. Perfomance measures for primary 
Journals would Include time lag In publication, frequency with 
which articles are cited, etc* Miscellaneous measures of 
performance for library operations are described In Horse's book* 
There ha/e been many efforts to attack the problen 

of cost effectiveness using only cost and perfomance data; 

11 

the reviews cited mention many such* Of course, what one 

really wants to do Is to maximize the difference between 

benefits and costs, each escpressed In dollar terms, and this 

can obviously only be done In the general case If the benefits 

can be quantified** (As King and Bryant^^ make clear. It Is 

it 

the benefit-cost difference, not, as sometimes Implied, the 
ratio, that is Important*) But in a restricted domalA It may 
suffice to use an uncallbrated measure of value, such as Is 
provided by performance ,lpdlces of the type dust described. 
Thus, If one has alternatives to decrease cost while keeping 
all performance measures unchanged, the choice Is obx^lous; 
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slmllarlyj an option of improving a performance measure^ 

while keeping costs and all other performance measures constantj 

again leads to an obvious declslonj 0\^bject only to the 

assxMptlon that one knoT^s which direction Is "better" for the 

12 

performance Index In question* Horse's book gives exajnples 
from the library field* More generally, one can, following the 
Hathematlca Beport, eliminate as "Inefficient" any alternative 
for provision of an information service which is "worse" than 
some other alternative In cost or in one of the several dimensions 
of performance space, while being "better" In none of these respects 
But if one alternative Is be.tter than another In one performance 
measure, worse In another, one will need to.be- able to compare 
utility quantitatively for the two measures* In some practical 
situations one may hoT^ever be able to do this, or at- least 
may be able to roughly identify, from common sense, a cone of 
directions in the space within which one Is sure the benefit 
is Improved* When different dimensions of performance space ^ 
can be intercon^ared, sophlstlcateGl optimization studies may 
sometimes be possible* 

ttofortunately, most economic decisions do not lend ^ 
themselves to this type of analysis, since most contemplated 
changes in an information service alter both costs and< benefits. 
These must be evaluated in the same units If the optimum 
trade-off is to be evaluated or even, in many cases, if one 
is to be confident of moving In the right direction* 
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4i Quantification of benefits; objective methods 

we come thus to the all-Important are» of calibration 
of benefits In dollar terms. The neglect of this area In the 
literature has been due more to the presijmed absence of handles 
for attacking It than to lack of recognition of Its Importance. 

22 

For exainple> In the most recent of the annual reviews Cleverdon 
states *'The major effort In the cpjnlng years should be the 
development of a methodology for determining the value of 
Information-retrieval systemSi" The difficulties In quantifying 
value for changes in Information services of course are not 
qualitatively different from those one encounters In valuing 
other types of Innovations In products or services; It Is just 
that most of the usual difficulties are a little more acute. 
In all cases an innovation changes the way people Kork^ and so 
changes their productive output. If one Is dealing with a 
service that affects only a particular group of people, one 
might concftlvably conduct an experiment with two matched groups^ 
one with the service In question and one without It, and 
compare their productivities, which In turn could hopefully 
be given a dollar value. In practice, this can almost never 
be done> though ve shall presently say a tev Mords about 
occasional situations where something approaching it would 
be feasible. In most cases the needs and objectives of different 
subunits in the user population will be different and Mill vary 
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with time, 8o that no matched groups can be found for 
comparlflon* Moreover, In the extreme yet very frequent case 
of a service that operates In parallel with other channels 
to communicate Information among diverse people or groups 
throughout the nation or the world, such a controlled objective 
evaluation Is obviously Impossible* Here one Is stymied not 
only by the diversity of the users, but by the fact that any 
change In the service In question affects a given user not 
only directly, but also Indirectly, through Its Influence on 
his colleagues near and far* Thus no tractable .small test^ 
population can be Isolated • ' 

Information services used In the performance of 
fairly standardized tasks offer the best opportunity for 
approximating the objective measure of benefits Just mentioned* 
For example, a computerized handling of medical' dat4 on 
patients might conceivably be evaluated by comparing' death 
rates and convalescence rates for hospitals using It with 
those for hospitals without It* An especially Important, class 
of cases offering a possibility for objective measurement 
occurs when the principal benefit of an information service 
consists in reducing the time requited for Its users to perform 
some accurately specif Iflable task which then must do whether 
the information service is available or not t The reasbn for. 
the underlined words is that if altering the service can alter 
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the frequency of choosing to perform the task In question, 
one must then compare the value of these tasks with the value 
of the other things the users devote their time to* Such a 
comparison would usually be very difficult, though It would 
be very useful, as It would enable one to Judge whether the 
workers In question allocate their time optimally* 

In view of the rather restrictive requirements that 
must be met for these objective measures of value to be applied. 
It Is not surprising that no studies have come to our attention 
which approximate the Ideal at all well* The closest approxlma* 
tlons we know of are typified by a few studies that use estimates 
(rather than measurements) of time saved by use of certain 
Information tools, and without checks on how well the proviso . 
underlined In the preceding paragraph Is fulfilled* For example, 
the American Chemical Society study*^^ mentioned earlier collected 
estimates from Industrial laboratories regarding time saved 
by use of various secondary services; the benefits of evaluated 
data compilations have been given a rough lower bound by 
estimates of time saved to certain Classes of users* ^ Dugger 
and Kllnger have given a sobering comparison of various user 
estimates of value. Including estimates of time saved* Quite 
noteworthy. Incidentally, Is an observation by Mueller^^ that 
enfxlneers often simply mark time while waiting for needed information 

Before leaving this topic we should caution that the 
conversion of a time saving Into dollars, though obvious In a 
C2iidesense> has some subtleties; we shalX discuss these below 
In Appendix C* 



34 



* 26 - 

5* Quantification of benefits: market response 

The discussion Just concluded has shown that It 
Is rarely feasible to establish an objective dollar equivalent 
for the benefits conferred by an Information service* This 
being the case, we must fall back on> subjective measures, l*e#, 
on Judgments by qualified experts that the benefit from an 
Information service Is worth so many dollars, or Is equal In 
value to some other quantity which ^an In turn be given a 
dollar equivalent* While one Is entitled to be suspicious 
of subjective Judgments, their credibility is greatly enhanced 
if the persons making them are: expert In the field where the 
service In question Is used; motivat ed,' In that their peJrsonal 
goals depend Importantly on the soundness of these Judgments; 
and numerous, so that Individual Idlosyncracles are likely 
to average out* And 6here Is Indeed a measure, of value, 
highly venerated In the science of economics^ that Is , based 
on subjective Judgments with all three of these characteristics 
this Is the "test of the market-place,*' In which the value of 
n product or service Is measured by the price Its users are . 
willing to pay for lt« We shall devote this section. And 
Section III#3 to the market approach! Section II#6 and 
will take up Mother approach, based on subjective Judgments 
with the same three characteristics, that Is often even more 
powerful for application to Information services* 
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Before going further^ however^ we must call attention 
to an Imoportant question that arises whenever one tries to base 
an estimate of benefit to a "universe of concern" (cf. Pig. 2) 
on value Judgments made by a variety of people* Each^of these 
people will evaluate the benefit of the service In question 
to himself (or to the organizational subunlt he represents); 
the benefit to the universe of concern Is not necessarily the ^ 
same as the sum of these self ^perceived benefits^ though In 
most cases of Interest to us It Is usually of the same order* 
For example, when a scientist who reads a journal article 
learns facts from It^ these benefit not only his own work but 
that of colleagues to whom he may transmit the Information orally 
and even colleagues In foreign countries ^ho may be made aware 
of this Information through articles he eventually writes* 
Yet his decision about paying for a personal sut)Scrlptlon to 
the Journal will probably be very little Influenced by such 
considerations* In the other direction^ buyers who are 
subsidized may occasionally purchase services that are not 
economically Justifiable for society* In extreme cases the 
self-interest of an Individual or group may even by strongly 
antisocial* for exwnple^ a would-be hijacker might be willing 
to pay quite a bit for detailed knowledge about the limitations 
of metal-detection systems* So If one uses Judgments from the 
user community^ one must always ask: what Interests do these 
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Judgments represent, and how are these related (quantitative^ ly^ 
to the benefit received by the universe of concern one, wishes 
to consider? 

To answer the question Just posed, one In general 
needs to set up an economic model that will provide quantitative 
relations between the Individual self-interest benefits and the 
benefit to the total universe of concern: this stejv designated 
by the words theory of social value** in Pig, 3> will be 
discussed In Item 7 below. Here and In Item 6 we shall discuss 
only the evaluation, in dollar terms, of the pluralistic 
self-interest Judgments, This may be called "dollar calibration," 
since It Is the crucial step In establishing a connection 
between the benefits of a service and the world of dollars* 

The fundamental assumption of the market approach 
to dollar calibration is that the prices buyers are willing to 
pay represent Intelligent self-lntereet Judgments* For various 
reasons this may not always be the case^ though usually It is 
haard to suggest who else could do better* Part of the fallibility 
arises from the fact that many purchasing decisions are not 
day-to-day decisions by individual users, but ate decisions 
made only once In a while by administrators, who may maintain 
only Imperfect contact with the actual users of the information 
services they buy. Green^ has reported results of a game 
played with marketing executives who were given decisions to 
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make regarding purchase of market surveys> etc*> the rules 
being such that mathematical methods of decision analysis could 
be used to detemlne correct decisions In every case* The 
decisions of the executives were by no means always optimal* 
While real*llfe situations might well lead to grass-roots 
pressures to revise poor decisions. It Is sobering to realize 
that executives, like evejryone else> are fallible* 

Even when one accepts the assumption of Intelligent 
self ^interest Judgments, on^ must face another difficulty: 
even the self- Interest value to the buyers Individually Is 
reflected! not Just In the price they actually pay In a given 
market, but in the prices (perhaps very different from buyer 
to buyer) which they would be willing to- pay If necessajry* 
(The relation to the demand curve of economic theojry Is detailed 
In Appendix B. ) While maiket statistics can give some Information 
on this, the Information Is usually rather sketchy* All too 

27 

rare Is the Interesting type of experiment reported by Urbach, 
In which similar groups of documents from NTIS were marketed 
at widely different prices, and the demands for the different 
groups compared* For the case of prtmajry Journals, fairly 

detailed studies of demand curves, etc*, have been made, e*g*, 

8 7 
by Berg, by the Mathematica group,' and by the SATCOM Task 

1^ 

Group* The first two of these have attempted a rough 
quantitative accounting for the dependence of demand on other 
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factors than price, namely, characteristics of the Journals 
and of the potential user population. But In all cases one 
gets only fragmentary Information on the value Judgments of 
those buyers to whom the value Is greatest. We shall explore' 
the seriousness of this limitation In more detail In Section 
111,3 below, 

6, Quantification of benefits: time Investment by users 
Though Its significance has not been as widely 
appreciated as that of free-market prices, the time that users 
of Information services choose to spend on them can be equally 
or even more valuable for purposes of dollar calibration, ^ 
Each Individual user Is perpetually making Judgments that 
balance the value he receives from use of an Information service 
against the value of what he might be doing In the same amount 
of time devoted to one of his other activities. If one can 
assume that on the average these Judgments are sound (note that 
an analogous assumption was also needed for dollar calibration: 
by market response) then one can estimate the dollar value of, 
the services to the users If one knows the value of their time 
and the (nonlinear) dependence of their ultimate productivity ' 
on the time spent^ on productive work. As before^ one must 
uBe some theoretical analysis of the sort to be described In 
Item 7 below, to obtain a corirect measure of true social value, 
or value to a given universe of concent, ftom the values perceived 
by Individual users. 
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To our knowledge the only published application of 

this approach Is that given In Section 11.^ of a study by the 

28 

Physics Survey Cooimlttee, although some slight use of It 

14 

Mas also made In the Report of the SATCOK Task Group; more 
detailed unpublished studies are, however, available. And 
although the explicit application to dollar calibration may 
not have been made, most of the sizable existing llterature^^ 
on time spent In the pursuit of Information can readily be 
applied to this end. 

We shall discuss this approach at length In Section 
III. 4 belOM, and In Appendix D. In general It seems very 
promising for a large class of cases since the three requirements 
for reliable dollar calibration from subjective Judgments, 
mentioned at the start of Item 3* are often even better fulfilled 
than for the approach via market response: Individual users 
are in general more expert than anyone else, even their bosses. 
In assessing the utility of day-to-day use of an Information 
resource) scientists and engineers (unlike some other workers) 
are usually strongly motivated to optimize their Individual 
productive output; individual users are the most numerous group 
one could consult. But one condition oust, be fulfilled If 
this approach Is to worki the Investment of users' time must 
be sufficient to be comparable In value to the other costs 
of the Information service In question.* For primary jcwmal** 



40 



- 32 - 



/ind for many secondary services"-^ this can Indeed be verified 
to be the case; however, It need not always be so. When 
only negligible time Is required from users* their decisions ■ . 
on use of the service will not usually be based In significant 
measure on the value of this time to them* so the basic assumption 
of the present approach will fall, 

7- Quantification of benefits; theory of social valv i 

As we have mentioned several tTife^ already, raw ^ 
inputs of the type we have been discussing In Items 5 And 6 
above need a certain amount of processing to convert, them Into 
valid measures of equivalent monetary value to the universe 
of concemi l,e,i to society or to a particular organlSlatl&ri ■ 
or group, ThuSi one must allow for the fact that su|r^iytng an 
information service to a particular individual In general 
gives a benefit to society that Is significantly different 
from the self-interest benefit perceived by this indlvltlual as 
he makes his decisions on expenditure of money for the -atfrvlce 
and of tljne for the use of It, If the doHar-calibaratlon =d*ta 
have been obtained from market responssi .one must often mAke 
some assumptions about the behaVloir of the demand curve beyoAd 
the range that Is empirically ajjcesslble. If the dollar 
callbrfttion is from uaera' time studies, conversion to socl&r 
value requires an understanding ot the other 'uses to which a 
given amount of time can'be put,' and atlao of the way iri which' 
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various channels for information flow are Interconnected*. 
(See the more detailed discussion in Section III. 4.) In 
either case^ one needs to construct a mathematlcal*economlc 
models the various parameters of which can be determined 
empirically, one of these being the dollar-calibration Input 
previously discussed. 

The general problem addressed by such models Is 
tha^ computing how the net benefit to a glven-unlv<rfte of ^ 
concern will change If a change Is made in one or a few of 
the controllable parameters of an information system. One 
must take account of the mfultlpllclty of parameters determining 
the costs and perfoimance of the system> and the response of 
users to it> and must allow for the fact that some of the 
parameters are determined from the others by conditions of 
economic or sociological equilibration. For ejcample, the 
benefit delivered to the U.S. by a published, data compilation 
will depend on the number of U.S. users> related to the number 
of U.S. buyers; the costs to the U.S. as a whole will depend 
on the latter number and on the sales abroad and the price. 
Domestic and foreign sales will depend on the price at which 
Itlft marketed^ according to certain demand curves. To compute 
the change in net benefit to the U.S. resulting from a change 
In price one would thus solve some simultaneous equations^ after 
having In some way obtained en^lrlcal forms for the functional 
relationships Just mentioned. 
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As In the case of dollar calibration^ the literature 
on the theory of social value of Information services Is 
quite meager; little of the extensive effort economists hive' 
lavished on modfels for the Interplay of conventional goods 
and services has spilled over into the information field. 

However, two of the studies by economists that we mentioned 

8 

in item 2 above deserve attention. Berg's study of the 
scientific Journal market considered the interplay^of free- 
market response and possible subsidization, and developed 
guidelines for the determination of the socially optimum mode 
of support of Journals, The Matheraatlca study*^ off fered' a 
number of general observations on such subjects as externalities, 

economies of scale, and the relative roles of subsidy and^ 
free-market income; it gave especially detailed attention to, tb^ 
question of optimal distribution of a given subsidy -budget over, a 
diversity of information Services, Machlup' s book, < though too 
broad to focus explicitly on the concerns of the present Report, 
contains many interesting qualitative observations* ^Ainong studies 
originating in the natural -science community, the SATGOM Task 
Group Report has undertaken a crude modelling of the social 

value of primary Journals, and the information report ot the 

28 

Physics Survey Committee has done a little modelling for 

information services in general, adapted to a user-^tlme input. 

We shall discuss these approaches in more detail in Section III. 4. 



43 



4 



- 35 - 



One conclusion, on which there Is iremarkable 
unanimity among all the studies cited. Is sufficiently 
Important to be mentioned here. Namely, for an Information 
service to be cost-effective from the standpoint of the 
nation as a whole. It Is by no means always necessary for 
It to be viable as a self-^supportlng operation when publicly 
marketed at a standard price* This Is because net benefit Is 
usually'maxi^ by marketing at or even below , replication cost, 
while It Is characteristic of Information services that Input 
or set-up costs are often the largest cost component* Thus 
some sort of subsidy If often In the public interest* 
8* Miscellaneous clues to cost-^effectlveness 

The preceding sections, based on the framework of 
Fig* 3# hopefully cover nearly all the possible approaches 
to economic decisions about steady-state operation of information 
services* However, the outline Is not quite alr-tlght, and 
there are occasional avenues of Investigation that do not 
fit simply into It but that may occasionally be helpful* We 
shall mention here only a few examples that have come to our 
attention* 

Sometimes one can draw useful conclusions by 
studying the subjective Judgments users make regarding relative 
value or cost to themselves (including the value of their time) 
Involved In the use of alternative information sources, but 
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without attempting an absolute dollar calibration*- Data 

on such Judgments can be used> for ejcample> to decide when 

a given information service will be of no value> because 

potential users will avoid it in favor of other competing 

services* This sort of analysis> analogous to the use of 

perfoiroance data to eliminate "inefficient channels" (see 

item 3 above) has been used by Brookes^ in a mathematical 

model for decisions on library-operation* - ^ ^ - - 

Surveys of user preferences, though often Unreliable, 

can occasionally be very useful* For example, wheri they 

reveal near-unanlmity> they can be used in the same- way as" - 

performance measures to eliminate " inefflcienb^i^hannel's^ . 

when the preferred service is no more costly than ^the ^ ^ . = . a 

27 

alternatives, Urbach ^ has given a practical exanqplie from^ - 
the NTIS operation* Another possible use of preference- ' 
studies is to decide which direction of a given peiforroance 
measure corresponds to increasing utility (evg*,^shouia— Invited 
talks at a meeting be Xonger or. shorter?) * More frequently, ^ 
one may wish to use such studies to determine how tOUeight 
several different performance. measures to get a sihgle ^ - 

(uncalibrated) measure of utility* Design and analysis of 
surveys for this purpose have been discussed, for example^ 
by Sadacca and Hoot*^? , , , ' 
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In all such vork one must be cautious about 
treating all users as equivalent* The opinions of those 
users who make a great deal of use of an Information service 
should be given more weight than those of occasional users* 
As in all other approaches to economic decisions^ one really 
ought to understand the topology of the many interconnecting 
information-transfer activities in the user community (see 
Section 111*2 below)* 

Correlations of productivity of individual scientists 
or engineers with their amount of use of information resources, 
though interesting, provide little basis for quantification 
of benefits, if only because it is difficult to disentangle 
cause from effect* However, such studies can be useful for 
thereason mentioned in the preceding paragraph: they can 
sometimes show, for ejcample, that a time-saving service is 
more valuable than would be estimated from mean use Btatlstlcs, 
if use is predominantly by the most valuable people* 

Studies of the frequency with which work previously 
done by one group is duplicated by another through ignorance 
of the earlier work can conceivably provide a valuable lower 
t^ound to the potential value of an adequate information service* 
Unfortunately, reliable data of this sort are very hard to 
come by, IVpical of attemp-iis to get such data are some 
£iludtes by Martyn^ (induccrlal chemists and university scientists) 
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and by Brockls and Cole^^ (presumably Industrial research 
projects). These and many similar studies have also obtained 
data on Information received which It would have been valuable 
to have had earlier; no quantitative measures of how valuable 
are available, however, 

9- Other practical considerations In a changing wbrld 

To conclude this section, we should say a few 
words about some of the Items In the second coliMn of Fig, 3# 
especially stability and motivation. These are important 
considerations for most economic decisions, and especially 
so for decisions about the Interplay of subsidy and free*market 
support for Information services, ^ : ^ 

Let us first consider the financial stability of 
an Information service. In the face of possible fluctuations 
In amount of Information to be processed, number of purciiaselrs 
of the service, or unit costs. The efifects*^of such factors 
on primary Journals have been discussed In detail in various 
places 3^*37*38 illustrate principles that ofteh apply to 
other types of services. Three typical conclusions, resulting 
from <lulte elementary economic analysis, are: marketing at 
a fixed price per volume of given size, rather than at a tlxed 
price per year, favors stability with respect to fluctuations 
In amount of material submitted; support of most of the pre-run 
costs by page charges provides stability with respect to 
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fluctuations both In material submitted and In demand; 
stability In the face of fluctuations In unit costs Is favored 
by both these measures* 

Motivation Is more subtle to analyze. Prom the 
national viewpoint, for example, one Is interested In motivating 
the managers of a service to manage efficiently and Imaginatively, 
In such way as to optimize net benefit to the nation* In some 
situations, for exan5)le, the keen use of the for-profit entreprene 
may be the most useful means of recognizing potential markets, 
lowering costs, etc*; In other cases, as In the common exan^le 
of unnecessary Journals, the profit motive can have very 
antisocial consequences* The SATCOM Ta,sk Group Report contains 
the most detailed study we know of concerning the Influence of 
various factors In motivation of Information managers to serve 
society well* As the work In this study shows, valid conclusions 
about motivation usually need to be based on a study of economic 
models of the type discussed in Item 7 above* 

The data that market research can provide will often 
be useful or Indispensable In arriving at practical conclusions 
both on stability and on motivation* 
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III. DISCUSSION OP THE MORE PROMISING APPROACHES TO 
QUANTIPICATION OP BBNEPITS 

Prom what has just been said In Section II, It 
should be clear that of all the elements depicted In Pig* 3 as 
entering into economic decisions, the cfnes most In need of more 
data and deepened understanding are the two In the last column 
encircled by the full line (dollar calibration and theory of 
social value); we believe that the Science Informa^tlon Council 
was thinking specifically of these when It ordered the formation 
of our Panel* Although stability and motlyatlop ar^^ somewhat 
Independent of the Items In the last column, and wotlvatlpn,^ . 
particularly. Is equally challenging and elusive, we have npt 
had time to explore them In detail; this section will therefore 
be devoted simply to a discussion of the mor^ promising approaphee 
to dollar calibration 6Uid theoiry of social value* We sl>ail 
start with some considerations common to all the major approach^ 
and shall then take iqp the practical aspeQts of quantifying 
benefits using Inputs of either the market-response or user-time 
types* Plgure 4, which summarizes the lii|)ort of ^ our survey , , 
In Section II, provides a concise reminder of why we consider > 
these to be the most Important topics to discuses. 
1* Nature of social value 

The social value, to which scientific apd 
technical Information services contribute Is that of . 
science and technology generally. Particularly at the 
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METHODS NOn BEQUIRING 
QUANTIFICATION OP BEKEPITS 



QlttirriPICATIOR OP BENEFITS 



COSTS VS. PERFORMANCE 
(ajvpllcable only to 
cbolces In ulilch 
all factors that 
Change do so f pvorablyJI 
or all unfavorably 




OBJECTIVE METHODS , 
(difficult) 



SUBJECTIVE 
METH$)!n3: 
dollar calibration bys 



must be, 
tj.ed toj 



'theort of 
social value! 



MISC. {jssm 

WEFESSEtfCBS, -ETC.) 
(very limited) 



MISC. 
(unreliable) 



THAT are: 
EXPERT 
COffCERHED 
PLURALISTIC 




. MARKET, response . 
(useful, but major 
shortcomings) 



INVESTMENT OP 
TIME EY USERS 
(special virtues, 
but not alwa^rs 
iqpplicable) 



Fig. 4. Avenues for steady-state economic decisions (digest of most 6f Section II). The areas 
at the rifipit enclosed by the fiai line are the ones to which Section III is devoted. 



research end of the spectrum* quantification of the value 
of scientific and technological Mork Is notoriously difficult; 
the mostj therefore^ that a theory of value for Information 
services can do Mill be to '*rlde piggyback" on whatever 
JudgAents .may already have been made abov^t the value of the 
entire scientific and technological enterprise. Specifically* 
Me shall assume that scientific and technological activities 
noM under vc^ do Indeed yield more value than they costj 

and that the amount of money noM being spent on them Is 

- - ' 

somewhere close to optimum. These assumptions may not be 
correct for example^ for reasons analogous to those 
d''^''eloped In Item 2 balOMj one might suspect/that Industrial 
funding of research Is suboptimum from the standpoint of 
the Mhole society — but correcting them is a^task for 
those Involved Mlth the broadest aspects of the nation's 
economy^ not a task for us. If F dollars of funding .give a 
yield of Y dollars vtorth of benefits In any enterprise to 
Mhlch these assumptions applyj Me may Infer that: 

(a) If the enterprise is being pursued^ Y>F. (1) 

(b) At the current operating levels 5Y/SPttl.. (2) 
A hypothetical change In an Information service Mil! alter the 
form of the function Y(F). The change In net benefit received 
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by •oci«ty, du« to th« ahanga In th« Information tervic«, can 
b* txprMMd In eithtr of th« ftltematlYe wayst 

6 (nftt benefit) » 6(Y*F) 

- -(6F)y, 

- (6Y),>[(^?p]»P (3) 

where {tY)jt is the change In Y that vould occur if the 
funding level were held constant, and {tV)^ is the change * 
in funding that would be required to maintain the same 
output using the altered service. 

In Appendix C, where these matters are discussed 
a little more fully> a further point is brought out which 
is sufficiently plausible intuitively to be quoted here 
without proof! namely, that in many cases 

6 (net benefit)* a little more than 

. Pp . ■ ■ {^) 

where 6^Y is the change in output which a fixed number of 
workers in a given enterprise would achieve in consequence 
of the altered ihfomatibn service, if their funds for - 
eupplies, etc.* were permitted to rise in proportion to 
their output, and where is a partially-loaded salary 
budget for the entezprise, cf the order of one and one-half 
times the bare salary budget. 

The'iCe is a further characteristic of most scientific 
and technological enteiprisee which greatly facilitates the 
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estimation of social vetlue. This Is that, most, of the 
Individuals and organizations involved In the enterprise 
are attempting to optimize* within what they perceive as 
their available range of choices* a measure of benefit 
which Is more or less parallel to the benefit of society 
as a whole* though often not quantitatively equal to It. 
In other words* one can often write 

BY « ?-^a^6Y^* (5) 

where 1 runs over the different perfomlng organizations or ' 
Individuals* 6Y^ Is the benefit which the 1-th such tries to 
optimize (relative to his costs)* and the quantities 
are positive numbers. Thus* universities and their staff 
members try to optimize their output of good-quality research'} 
Industrial laboratories try to optimize the technology for 
producing useful products; hospitals try to optimize speed 
and effectiveness of healing; etc. In some areas of human 
activity thislArallelism of individual and societal goals 
fails completely: for example^ in warfare^ or in the. cigarette 
Industry* a^^ can be negative; in schools of astrology*^ 
may be essentially unrelated to QY, While such nonp^raXlielism 
may sometimes occur in activities affected by sclentiflo eind 
technical information services* such cases are probably a- 
small proportion of the total. When (5) holds* the- problem 
of estimating the change 6V in total social benefit >^uces 
to the local problems of estimating the QY^^* and 'the cooperative 

■ ■■ t ■'> : • 
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problem of estimating the coefficients a^^. The latter are 
usually greater than unity (though sometimes not By much) 
because strengthening one element of the sclentlflc-techiiologlcal 
enterprise usually provides Indirect benefits to other elements. 
2. Bnportance of the topology Information-transfer chtmnels 
Useful Information Is transmitted through a multi- 
plicity of channels, which we have sketched In rather general 
terms In Fig. 1 above. These operate both In series and In 
parallel: much of the Infoimatlondellvered through any 
channel was In turn fed to this channel by some ox^her channel; 
often the same Information can be transmitted Independently 
In two or more channels. Thus a change made In a particular 
Information service affects not only the amount, speed, and 
quality of Information transmitted by this service directly 
to users, but also affects the amount and utility of Information 
which they receive through other channels which may have been 
nourished by the service In question. Moreover, the change 
will cause the relative use of the different channels by 
the user community to shift. The problem of computing the 
effect of the change In question on the total flow of 
Information Is analogoue to the problem of computing the 
change In the Impedance of an electrical -network when one of 
Its elements Is altered. Thus a prerequisite to any quantitative 
understanding of the effects of changes In Information services 
is a knoMlndye of how the different channels of information 
flow are infc^rgflnnected and how much information flows In the 
different parts of the whole . 
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There Is a modest but significant literature on 

the relative use of different communication channels by various 

kinds of scientists. There are also a number of 

studies of communication among engineers, Mhlch show 

markedly different patterns from those prevalent among scientists. 

Most existing studies fall somewhat short of what one would 

like, in that they have concentrated mainly on the last link 

of an information-transfer chain from originator to user, and 

have not adequately elucidated the way in which different 

information channels interconnect. Nevertheless, they can 

still be useful as a guide for the' setting up of models for 
estimating the effect of changes in a given service on total 

information flow. One rather sketchy study^3 has provided 

details of this sort for a particular area of physics. This 

study also made the useful distinction between trfonsmiaiton* 

of scientific infomation Itself (e,g,>. a foxnula, a deHvation^ 

a datum, a methodology) and tranimlaiion of a clUe td the 

existence or whereabouts of such information. Studies- by Allen 

iiii 

and his collaborators in organizations of, a more engineering 
type have also been very revealing^ showing the ^oncenti^tion of 
information flow through certain individuals called "gatekeepers.'* 
It would be most interesting to have further studies' that would 
show how the pattern of interconnection of different' conmuhlcation 
channels differs from one field to another and in different- 
organizational environments. 
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To emphasize the practical reality of this laaue 
It may be helpful to cite an example* Every nov and then a 
study appears In the library literature on the question of 
weeding collections or economizing on subscription and storage 
costs for periodicals* A common and superficially plausible 
suggestion Is that one should drop subscriptions to Journals 
for which the quotient of frequency of use by bulk or subscription 
cost is much lower than average*^ ^lle statistics on frequency 
of use are obviously vital for Intelligent library management> 
it is risky Indeed to take benefit delivered as proportional to 
number of occasions of use* Certain Individuals may pick up 
Important information from Journals their colleagues rarely 
consult> and pass It on orally> etc* In the extreme case of 
dominance of Information flow by "gatekeepers,"^^ the pattern 
of literature use by the latter, who may constitute no more than 
a tenth of the professional population, may be more Important 
than that of use by everyone else* 

To give a numerical example. In the library of the 
Bell Laboratories, at Murray Hill, New Jersey, Busslan-langu&ge 
periodicals occi^y about 5^ of the shelf space^ but account for 
less than 1^ of periodical use, pnobably' about the 0*5^ found 
by Chen at the MIT library* If these figures were specialized 
to physics, both numbers would be a little higher, but probably 
not by much. Yet at a "journal club" where various individuals 
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reported on particularly exciting new discoveries In the 

current physics, about 12^^ of several hundred Items came 

Trom l^usslan-language Journals (before these were translated)* 

Thus the Oi55^ use figure, which one might discount even 

further because of the existence of translation Journals, would 

probably significantly undervalue the Russlan-lang:uage journals* 

3* Benefit analyses based on market response t 

The relation of value to buyer response Is particularly 

simple If one can make the simplifying assumptions: first, that 

the total social benefit delivered by a service Is the sum of 
the benefits delivered through each of the purchasers of the 

service, and second that the contribution through each purchaser 

to the total social benefit Is the same as the self*lnterest 

benefit perceived by that purchaser^ In such case Eq« (5)-applles 

to any change In the service, with all a^=l* The benefit r^^lzed 

from providing purchaser 1 vlth the service Is measured by the 

maximum price he Is willing to pay for It. The "demand curve** 

of economic theory Is sloqply the curve showing the number of 

people willing to pay more than any given price; it is customary 

to plot price vertically and number horizontally, as shown in 

Fig. 5« It follows from very simple reasoning, detailed in 

Appendix B, that the sum of the values received, by all buyers 

who purchase a product or service* not available elPewhere . 

and offered at a single price p, is simply the area lying 

between the demand curve and the price axis and to the left 

of the vertical line Intersecting at p, as shown shaded In 

Pig. 5(a). 
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Fig. 5 Demand curve (relation of number N buyers to price p) 
for a product or service, (a) Shaded area ^hows total 
benefit delivered, (b) Change In benefit delivered 
fshaded area) due to a change In the product resulting 
in a change of the demand curve from the full to the 
dashed form, (c) Change In benefit delivered (shaded 
area) due to a change In price alone. 
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Aside from the assumptions already made> the weakness 

of this method of estimating value lies In the fact that It 

requires knowledge of the shape of the demand curve up to 

very large values of the prlce> where empirical market data 

are almost never available* Any change In the service offered 
will normally change the entire demArid curve, say from the 

full line to the dashed line In Fig* The social value 

of this change> under the present simplified asexMptlons, Is 

represented by the shaded area In Pig* 5(b), but this depends 

on the forms of both curves over an empirically Inaccessible 

range of prices* While one can sometimes approximate the 

curves by simple analytical forms which allow extrapolation 

to Infinity from the often measurable slopes of the curves 

In the neighborhood of the present price p, the accuracy of 

such extrapolations is questionable; for exanple, the most 

commonly assumed form, a power law dependence, often gives 

the nonsensical result of Infinite areas (see Appendix B) * 

The situation is considerably better, however, if the change 

one wishes to evaluate consists simply in a change of the 

price at which the service is offered^ without any change in 

the nature of the service* In this case, as shown in Fig* ^(c)^ 
the change in social value delivered is simply the area 

of a vertical stripe bounded by the demand curve, and can 

easily be estimated from the known market response at the 

existing price* 
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In practlcei the simple assumptions underlying the 

discussion Just given (identity of social and individual value 

JudgmentSi additivity of these^ absence of competing services) 

are rarely adequate, and corrections to them must be made. 

Consider first the question of competition. Occasionally it 
happens that services which from a broad societal viewpoint 

could be regarded as competing* do not acfcu&lly compete for 

user response. Primary Journals provide on example: while 

either of two Journals in a given field could provide a 

publication,, outlet for authors in this fieldi buyers who 

purchase one of the Journals cmd not the other will not have 

access to the articles in the latter. As has been notedi^ 

this fact is responsible for the proliferation of overly 

expensive Journals, But In general things are not so slnsple. 

For example, secondary Information on the physics literature 

is provided both by the AIP SPIN tapes and by the INSPEC tapes; 

the coverage of the latter Includes that of the former and 

is considerably greater, but tiie former contains citation 

Infozviatlon which the latter does not. Clearly one would need 

to know a lot about the market response to both services in 

order to evaluate from market data the social value of a 

hypothetical change in one of them. 

Consider finally the relation of social value to 

the individually perceived values of purchasers. Of the 

various effects that' can cause these quantities to differ, 

probably the most iiH)ortant is the nourishment of informal 
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channels for Information transfer by the formal ones, or 
of various formal channels by each other. Thus, the social 
value of Infonftatlon delivered by a service to a particular 

Individual lies not oniy in Its eff ect oa the productivity ^ 
of that "individual, but also in Its effect on the useful 
information which he can couaninlcatc to his collea«u«s, either 
orally or through his i»rltliig». The Individual will usually 
not take the latter contribution Into account in deciding 
how much the Information service Is worth to him. The market , 
estimates of value we have been discussing in the preceding 
paragraphs therefore need, in many cases, to be multiplied by 
an amplification factor — I.e., a^^^s > 1 In (5) --'whose 
evaluation requires knowledge of the, pattern of information 
flow. For som* typical cases involving scientific Journals, 
It has been estimated^ that a factor of the order of two may apply. 
4. Benefit analyses based on allocation of time by useirs . 

As ve have noted In Section II, a measure of the self- 
interest value of an Information service to a user Is provided by 
the amount of time which he chooses to devote. to using It. If 
users on the average can be assumed to apportion the time they 
devote to Information services optimally, the additional benefit 
that would be derived from spending one more hour in the use of 
an Information service must have a dollar value (to the user) 
equal to that of the loss in output resulting from a decrease 
of one hour In time devoted to productive work. If one makes 
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the tempting assumption that a worker* 3 useful output is the 
product of a function of the fraction of his time he devotes 
to productive work by en efficiency factor dependent on how 
i#ell informed he is, one has the basis for an economic model* 
Thus^ we may represent the value of a worker's output as 

Value of output s Y 9(l-t^-t^)E(t^, t^) (6) 

i*hete t^ is the fraction of his ^ time he devotes to use of 
ft pftrticular Infomatian servicei t^ is the fraction he 
devotes to other not directly productive activities, including 
use of other information resources, and E is the efficiency 
factor* The optlmality condition Is then^ If t i-t^^-t^. 

Since 9 is a superlinear function of its argument, whose 

form can be roughly guessed from common sense or estimated 

from the experience of people who have had sizable amounts of 
time siphoned off to administrative or other duties, and since 
the product (pE, or at least a lower bound for It, Is known from 
the expenditure made on the scientific or technological enterprise 
In question, we can obtain an estlmage of h^/ht^* If we know t^ 
and can make reasonable assumptions about the functional dependence 
of h: on and on any contemplated innovations, we can then make 
a quantitative estimate of the effect of these Innovations on Y* 



er|c 



62 



- 53 - 



Some examples of how this can be done are discussed 
In Appendix D. One important type of example Is that of an 
innovation capable of saving time for users of a service. As 
the detailed discussion of the example shows* the value of 
such an innovation exceeds that of the time saved (if the 
latter is valued at the normal loadedie4il«ry rate -men- 
tioned In Appendix 0} because of two types of amplification 
factor: 

(a) A factor of the order of 2 or so due to the 

fact that only a portion of working time is 
devoted to directly productive' work, and to 

the fact that the function f in Eq. (6) Increases 

significantly more rapidly than linearly with 

its argument. 

(b) An additional, factor, of the ordejt of 1^ in 
the exan^le discussed in Appendix J>» but 
likely to vary considerably from case to case, 
due to the fact, already noted In Item 3 above," • 
tiiat supplying one user with InfoVBAtion ' 

facilitates the work of his Colleagues. 

Though we feel that this sort of approach through usezs' 

time has great possibilities, it needs checking and refinement at 
several points, an<3, as we had already noted In Section II. 6, it 
cannot be \ised for Information services that require negligible 
time from their users. One point requiring further research is 
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the assumption thatj at least on the average, Individual users 

allocate an optimal amount of time to each available Information 

service* While this assumption Is doubtless no worse than the 

corresponding assumption of Intelligent self-Interest that one 

must make In order to calibrate value from market response^ and 

while one may legitimately argue that Judgments of users relating 

to their everyday work are more likely to be sounds on the 

average^ than anyone else's, there are serious grounds for 

suspecting that systematic mlsjudgments In time allocation do 

k7 

indeed occur* For example, there have been a few studies ' 

of the use of Information resources as a function of the 

distance one must travel to use them; these have all shown 

a fall-off with Increasing distance rather more rapid than 

could be explained by tha^vaiue of the extra time involved* 

Use therefore cannot have bean optimal for all values of 

the distance; It was probably suboptimal at the larger distances* 

Our crude models based on Eq* (6), has Ignored Individual 
variations In the user population, and so has not made use of any 
Information about possible special roles for ''gatekeeper*' types^ 
etc* Generalizations In this direction would be very desirable* 
Also^ It has assumed that the major conserved quantity Involved 
Is simply tlmej an alternative point of view might be that 
the Important quantity Is the Individuals* available mental energy* 
As shown In Appendix In the simplest cases one can scale out 
the dependence of energy consumption on time to give a model that 
is again of the form (6)j however, different kinds of time 
(e*g*t time spent walking to a library versus time spent deciphering 
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an opaque paper) would require different scaling factors* In 
any event, more sophisticated attention to the multidlmensionality 
of the time variable, for which we have broken out only and 
(or> in Appendix D> t^, t^, and t^), would be desirable* 

In summary> we feel that intelligent studies of the 
way users of information resources distribute their time and 
of the Interconnections of the channels through which they 
receive information provide an extremely promising tool for 
attaching a quantitative value to hypothetical changes In 
information services* However> implementation of this approach 
will require more extensive and more sophisticated studies of 
these factors than are now available* In Section IV to 
follow we shall give a few exaji^les of how both this approach 
and the market approach might be- applied to some of the 
decision questions we listed In the Introduction and In Appendix A* 
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IV. ILLUSTRATIVE EXAMPLES 

In the Introduction, and in more detail in 
Appendix A, we have mentioned a number of typical examples 
of economic decisions on various typss of Information systems, 
which would be helped If a quantitative measure of benefit 
were available* We would now like to return to some of these 
examples — It would be too time* consuming 60 consider them 
all — In order to show how approaches based on market response 
or on studies of users' time might conceivably be used In 
order to obtain the desired quantitative measure of benefit 
and make the required decision. Our discussion of these 
examples here will be quite condensed; Appendix E describes 
our suggestions on them In more detail. However, It Is to 
be stressed that these suggestions are only Illustrative: 
they are Intended only to show that It Is not difficult to 
think of plausible ways of biting in on most of the problems* 
The really optimum procedure for dealing with each could of 
course only be determined after much more detailed study, and 
In some cases It might well turn out that our suggested approach 
has a total flaw; at the very least, better numerical Inputs would 
be required* 

We shall consider here four of the thirteen examples 
mentioned in Appendix A* These will be, respectively, the 
ones nxMbered 1, B, 9j and 11, there: 
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(1) When should a university or other research. 

organization split off local departmental 

libraries from a centralized library? 

This is a problem for which the user-time approach 
is especially well suited. The basic ii^ut data would be the 
amount of time that staff members, graduate students, etc., 
spend in use of library materials, and the amount of additional 
time they would need to spend for the same use if the library 
were in a more remote location. If use were optimum in both 
locations, these lata could be usetS, following the methods 
sketched in Section III. 4 above, to derive a measure of the 
loss in productive output that would be entailed by shifting 
from a nearer to a remote library. This loss could be e:^resaed 
as a product of number of people involved times salary (or 
equivalent measure, in the case of students) times a loading 
factor times a sizable amplification factor arising from the 
auperlinear dependence of productivity on time spent in productive 
work and from the feedback from library use liito other 
chaxmels of communication. However, a major correction 
would need to be researched and then inserted! all indications 
are that use of a remote library will fall far more rapidly 
with increasing distance than can be e:^lained by the effect 
of Increased travel time on an optimal pattern of time allocation; 
in other words, use falls far below optimum. Carefully 
designed studies would be needed to quantify this effect, but 
would probably be feasible. 
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(8) When Is subsidy of a translation Journal 
Justified? 

Here an approach based on market data could be 

Itnmedlately useful, though It would be helpful to supplement 

It with specially designed user-time studies* Prom the 

general trend of cost-clrculatlon statistics, one could 

estimate how much the circulation of any given translation 

Journal would Increase If Its subscription cost were reduced 

from the value necessary to cover the entire expense of 

production to a value near the run-off cost* Thus one could 

estimate the Increase In area under the demand curve, as shown 

In Plgi 5(c)* As explained In Subsection 1 above, this area 

provides a raw measure of the Increas^ In benefit delivered to 

the user community, a measure that needs to be Increased by a 

factor slightly > 1 to take account of the nourishment of 

other communication channels which benefit the user community 

as a whole, but may not benefit the Individual buyer or 
purchasing Institution* The production cost to society as a* 

whole would rise only slightly (more copies printed). Thus 

whether to subsidize or not would depend on whether the 

compulsed benefit appears to be sizable or only minor. In 

comparison with considerations In the ^'practicality*' column 

of Pig* 3* 

(9) When should a scientific society adopt a 
larger page format for Its Journals? 
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Here the user- time approach Is the obvious one 
to be usedi One vould need to make special studies of 
reading time required for a given level of comprehension 
using the t^o page formatSi For literature vlth many equations 
and figures, the reduction of the need to leaf back and forth 
to connect these should lead to quite a measurable difference 
in efflclencyi which could well be of the order of the 10?^ 
or even 20^ difference sometimes found between different 
typographies for straight text* ^ Multiplying this percentage 
by the mean total time spent by all users of the Journal in 
question by their mean salary by a loading factor by an 
ainplif Ication factor (due to superllnear dependence of productivity 
on working time and to interaction of different communication 
channelsi as discussed in Section 111,4 above), one could 
derive a measure of benefit delivered by the proposed change* ^ 
This could have to be compared ^Ith increases, if anyi In 
productive cost, changeover costs, and effects, positive or 
negative, on library storage coBts> etc* 

(11) When should the government subsidize the 

input of citations onto a tape service 

produced as an adjunct to an A and I 

publication? 
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Though market statistics on citation- Index services 
could be very useful If available. It Is likely that at the i 
moment a user-time approach would be best* A few data are 
already available for some populations on the amount of time 
spent In the use of existing citation Indexes* Such data 
could be augmented andconverted, by methods similar to those 
sketched In Section 111*4 above, Into a measure of the benefit 
that would be lost If users who now have access to a citation 
Index were deprived of It, or of the benefit which would be 
gained If those lacking such an Index were supplied it. As ; 
this benefit comes out to be quite large (see the sample 
numbers In Appendix £), and as existing studies (which should, 
of course, be extended) show that only a minority of those 
l*ho could benefit from such a service now have access to It, 
one could probably set lower bounds to the benefit that would 
result from marketing of an lne3q)enslve service* Obviously, 
however, some market research would also^ be desirable, as 
i*ell as further research on the Interaction of information 
derived from a citation service with other channels of 
Information flow* 



- 60 - 



70 



- 61 - 



V , RECOMMENDATIONS 

What should be done In the Immediate future? 
Any organization that supports or provides an infonnatlon 
service has an obligation to know something about Its 
social value and to use this knowledge to guide decisions 
on the expan&lon> dlscontlnuance> or modification of the 
service, However> we shall not attempt to detail here the 
many types of efforts that diverse goveiTimental and non- 
governmental organizations could usefully make In this 
direction* Rather, we shall concentrate on those things 
that OSIS could usefully perform or support for the purpose 
either of Improving the wisdom with which the bulk of its 
funds are spent, or of providing to COSATI> and hence to 
other agencies of the goveniment, guidance on the wise 
expenditure of their funds. Referring again to Fig, .3i we 
shall further concentrate on recommendations In the circled 
areas « 

As detailed In Sections III and XV^ lie feel that In 
many cases there are prospects for significant progress In the 
quantification of benefits through studies of liow users, 
distribute their time and of how useful infoimatlon diffuses 
from Its originators to Its users. So far these prospects 
have been very Inadequately exploited. So we recommend: 

(a) Studies should be undertaken^ in greater breadth 
than dqpth than In the past> of the time 
scientists^ engineers^ practltloners> and 
administrators devote to the ^se of various 
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kinds of information services, and of the 
interconnections by which the various channels 
for the communication of useful information 
nourish each other. These studies should be ^ 
undertaken with adequate awareness of, and 
even In collaboration wlth^ their use In economic 
models designed to quantify value [see Recommendation 
(b) below]. 

In cases where such studies support the hypothesis that users 
distribute their time optimally for their self-interest, they 
can provide a foundation for quantitative estimates of value; 
In cases where nonoptlmal use Is uncovered, they may suggest 
ways of Improving productive efficiency through user education, ' 
(b) Further work In economic theory should be 

supported. Several areas are worthy of attention: 
the general theory of value of Information 
services, taking account of their Interactions; 
specific mathematical models for particular 
kinds of services; theory of market response, 
A prerequisite for all such research, however, 
should be adequate acquaintance of the analysts 
with the practical characteristics and patterns 
of use of the Information services to which 
their work Is supposed to apply. In particular, 
they should be given the best possible access to 
the Information developed in pursuit of 
KecommendaClons (a) and (c). 
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Mote especially that the wording of these first recommendations 
calls for integration of economic theory with data collection. 
Data collection must be planned to provide the inputs, that 
economic models will need^ and modelling must be realistic and 
not outstrip by too far the collection of solid data, 
(c) A systematic monitoring should be undertaken 
of the markets for scientific and technical 
Journals, secondary publications, products of 
information-analysis centers, and other 
information services. Data on prices and 
circulations, and on their changes with time, 
should be readily available to decision-makers 
and to researchers in economic theory. 
Occasional experiments on response over a 
wide range of prices* like that mentioned 
earlier, should be stimulated and encouraged. 
Regularities In the growth of markets should 
be studied, and In appropriate cases research 
should be undertaken on the market response to 
projected servlcesi especially If these ^are 
to be subsidized. 
(The simplest sort of consideration of the economics of 
benefits versus costs leads to the conclusion that subsidy 
of Information services Is usually socially Justifiable to the 
extent of Input costs: If a service Is worth providing at 
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all, the net benefit realized from It Is optimized If It can 
be marketed at, or sometimes below, replication cost* However, 
the service may not be worth providing at all, and one way 
of finding out If It Is worth providing Is to know something 
about the tall of the demand curve. In most cases It Is of 
dubious practical wisdom to offer a service free or to market 
It at less than incremental cost; In some cases, pricing so 
as to recover full costs, though not optimum In terms of the 
strict benefit-cost difference, may be optimum for practical 

reasons • ) ■ 

(d) When plausible opportunities present 

themselves for studying the influence of 
various possible support mechanisms on the 
stability of an Information service and on 
the motivations for good performance by those 
responsible for It, such opportunities should 
be followed up* 

The data and conclusions resulting from any of the 
work recommended above should be most energetically publicized, 
to bring them to the attention of decision-makers In societies 
and research organizations, as well as In government* In 
addition, measures might be taken to make large organizations, 
governmental or nongovernmental, more aware than they now are 
of the possible utility of studies which they might conduct oh 
their own In the area of cost effectiveness and quantification 
of value. In particular, we urge: 
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(e) Acting through COSATI, OSIS should keep other 
agencies of the Federal government lnforme<i of 
the state of development of techniques for 
quantification of benefits^ and should assist 
them in making economic decisions on their 
Information programs* It should vork for the 
development and acceptance of enlightened 
guidelines by v!hich agencies can Judge vhen 
subsidy of an In-house or ejctramural Information 
service is appropriate* 

While the studies envisioned In Re commend at ions 
(a), (b), and (d), and part of (c), can for the most part 
be conducted ejctramurally^ or perhaps by other government 
agencies stimulated by OSIS, their intelligent coordination 
vill require considerable expertise on the part of the OSIS 
staff* Such expertise v^ill be especially important for the 
leadership role called for In Recommendation (e)« W6 
therefore make the final recommendation: 

(f) OSIS should try systematically to build up - 
the expertise of its staff In the area of ^ ^ 
economics of Information ^vlces, ytXth th^ , , 
goal of having as soon as feasible a sen^pr 
professional of high ability \iho vill devoifu, 
the major portion of his energies, to this f^eld* 
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APPENDIX A. MAJOR TYPES OP INPOEMATION ACTIVITIES 
AND TYPCIAL DECISIONS REQUIRING 
QUANTITATIVE ESTIMATES OP VALUE 

A nice brief eumniary of the scientific and technical 
information activities of the Pederal government can be foiund 
in the periodic NSP publications Pederal Funds for Research, 
Development, and Other Scientific Activities ?* However, as the 
caveats in these publications make clear, the expenditures 
they report are not a complete listing, and the total is only 
of the order of half the billion dollars a year we quoted in 
the Introduction. In Pig. 1 of the text and in the discussion 
below we have broken the activities down into categories of 
our own making, and have made rough estimates of expenditures 
from all sources available to us. The categories of Pig. 1 are: 
A. Technical libraries . As might be ejtpected from their 
Indispensible role as purveyors of recorded Information, 
libraries loom very large In economic terms. According to 
the best estimates we have been able to get^ the Federal 
government's expenditures for technical libraries are currently 
something like $100 million per year; although comprehensive 
data are hard to obtain. It seems likely that the operation 
of the scientific and technical coaiponent of our nation's 
libraries Involves additional annual expenditures of hundreds 
of millions of dollars by universities. Industries, etc. Some 
sainple decision questions are: 
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1* When should & university or other research 

organization spilt off local departmental 

libraries from a centralized llbraiy? 
2« What Is the optimum number of subscriptions to 

an Important Journal which a library should 

purchase? 

3i How much Is It worth to support research and- 
development for better and cheaper mlcrofonk 
readers? 

B* Systems for selective dissemination of Information €md 
computerized services * These are coming increasingly into use 
in industrial and miss lon-orlen ted organisations^ While 
we have not seen any breakout of expenditures for such 
services, we have inferred a lower limit of some tens of ^ 
millions of dollars a year by the government alone* .Bi^peclally 
Important are a nimiber of unlverslty^centered retrieval' systems 
supported by the NSF and capable of making available to users 
the content of tapes Issued by the producers of large A and I 
services* Typical questions are: 

4* When should a research organization put ' ^ 
into operation a selectlve-dlssentination 
system for Its staff? * ' 

5i How large a data base should a computerfirtttl 'f' ' 
retrieval system attei!?)t to cover? 3^ 
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C, Informatlon*analysls centers . These are lumped together 
in Pig, 1 with information service centers (e,g,> weather 

data centers), the dividing line between the two being a little 
fuzzy. The two together probably account for something like 
$200 million of Federal expenditures, but probably less than 
half of this amount is spent on the sort of processing activities 
envisioned in the Weinberg Report under the term Si)eciali2ed 
information centers," The number of centers of this latter 
type has> however^ been growing steadily; these are included 
in COSATI's 1968 list of some 111 centers supported by the 
Federal govemmentjP^ over three-quarters of these were devoted 
to scientific or technological areas. Much of the most fundamental 
data analysis in the basic sciences is done in centers supported 
by the Office of Standard Reference Data in the National Bureau 
of Standards^ which has an annual budget of about $2,4 million, 
A typical question is: 

6, When is it worthwhile to start an information* 

analysis center in a new, field, or to , significantly . ^ 

expand an existing center? 

D, Journal production . Although no comprehensive compilation 

156 Tit ' ^ ^ ' ^ ~" ' 

exists> available evidence suggests that prlniapy publication 

in the United States of basically new scientific and technical 

knowledge amounts to over a million kilowords annually. The 

corresponding expenditure by the publishing organizations must 
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therefore be in the range $50 to $100 million. While, direct 
government support is limited to Journals published by government 
organizations and emergency subventions! such as those for the 
initiation of translation Journals^ a sizable antl growing 
proportion of the production cost of regular Journals is met 
by page charges, the majority of which are paid for from research 
funds supplied by government agencies. Some typical deeision 
questions are: 

7, To what extent should the government encourage, 
page-charge financing by providing funde for 
it in grants and contracts? 

8, When is subsidy of a translation Journal Juatlfied? . 

9, When should a scientific society adopt a .lay^er ^ 
page format for its Journals? 

E. Schemes for distribution for reports and preprints * , The 
National Technical Information Service in 1969 offetred ;aoine r 
45iOOO reports for distribution. A still larger nwnbei; 
of government reports were not made available througl)^ this 
service^ but distributed only by the originating, agencies. 
It is probable that a sizable part of the roughly ,$lpQ tiillion 
reported In Federal Pund^ es spent annually for "publication > 
and distribution" pertains to reports. In a . different! -relp, 
the notorious Information Exchange Groups operated, by the 
National Institutes of Health sent out In 1966 about jOne and 
one-half million copies of preprints. Before the experiment 
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was discontinued^ possible e^^ansion to an operation with 
annual costs in the range $10 to $100 million were being 
talked about.^^ A typical question might be: 

lOi vnien> and on what scale> should preprint 
exchanges be subsidized? 

F* Abstracting and indejcing publications * Scores of these 
are produced directly by the government, most of them rather 
small but some quite larger the latter are exemplified by 
Index Medicus, Nuclear Science Abstracts, and STAR* Adding up 
some rather old data on number of literature items covered 
by these, we get over half a million for the year I96O; this 
probably implies well over a million today* There is also 
sometimes ongoing subsidy of externally produced services, 
typified by that of International Aerospace Abstracts* OSIS 
has in the past given considerable developmental support to 
society-run discipline-oriented systems* The government's 
expenditure for all these items could well exceed $20 million 
a year; nongovernmental expenditures are doubtless considerably 
greater* Some typical decision questions are: 

11* \fhen should the goveniment subsidize the 
input of citations onto a tape service 
produced as an adjunct to an A and I publication? 
12* When is direct or indirect subsidy of an 
A and I publication Justified? 
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13. Should an abstract Journal computerize 
its annual*-indejc production to enable the 
index to be produced more promptly? 

G, Review grants^ etc . In contrast to the extensive work 
at Infomatlon^analysls centersi there has been very little 
Inveetaient of resources by government or societies for the 
purpose of encouraging individuals to produce reviews^ 
treatlses> and data compilations, A key question Is: 

14. Should an agency supporting research divert 
some of Its research funds to a program of 
grants to authors for the preparation of 
reviews and compilations? 

H, Educational resources - This Is a very large area, and 
one In which the quantification of benefits Is even more 
difficult than for most other types of information services. 
We shall not attempt to give examples for this area, 

I, Meeting support . Most of the support of scientific and 

technical meetings Is supplied by research and development 

organizations, through payment of registration fees and> most 

Importantly, of travel expenses for attendees. As .the total 

Investment of resources has been estlJuated at something like 

28 

$8 or $10 million for the field of physics, the total for 
all fields may well be of the order of $100 million; explicitly 
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APPENDIX B, DEMAND CURVES, AND THEIR 
RELATION TO BENEFITS DELIVERED 



Figure ai(a) shows a typical demand curve. In 
which the abscissa is the number of purchasers of a product 
or service when It Is offered at a price represented by the 
ordlnant. We assume for the moment that the price Is the 
same to all biiyers, and that the social value delivered to 
any* buyer Is, at least on the average, equal to the self- 
interest value "he perceives for the product. In other words, 
to the maximum price he would be willing to pay for It, 
The width of the doubly shaded strip represents the number 
of buyers to whom the value is greater than p^^ but less 
than the slightly larger value Pg- The area of this strip 
thus represents " under our simplifying assumptions — the 
value this group of buyers receives from the product (provided 
the price Is below p^^) * The total value received by all 
those who purchase the Journal when It Is priced at p^ Is 
obtained by adding the contributions from many such vertical 
strips and is, therefore, the total shaded area: 



Meneflt delivered - 



o 



W{p)9P (B.l) 



This Is a gross benefit. If the cost of providing 
the product or service to N buyers has the simple fom 



Cost = Cq + EN , 



8a 



N 




Bi^2 

where ia tha "input" or "aet-up" cost, and R ig the 
unit replication coat, then the net benefit Is given by 
the shaded area in Fig* El(b)> vhere the circular hole la 
chosen to have area 

o 

The logarithmic derivative of the demand curve, 
3 ^ 3tnN/5tnp, Is what Is called the price elasticity of 
demand* It la normally negative, and under .usual operating 
conditions has a magnitude that Is usually a fraction of 
unity* If the price elasticity of demand were constant 
over the whole curve then we should have Nocp^* This Is, 
however. Impossible, for 3 > -1, since It causes J Ndp> to 
dlve"*^e* 

In practice this simple measure of benefits will 

need to be corrected both for ^^externalities" (positive or 

negative benefits realized by society through providing 

the product or service to a particular buyer, which do not 

enter Into this buyer's self* Interest Judgments), and for 

the Interaction of competing but usually not Identical products 

In the marketplace* The fomer of these has been briefly 

discussed In the SATCOM Task Group Report, and the Physics 

survey Report; the Mathematics Report*^ discusses both, and gives 

* 

fairly detailed attention to the latter in connection with the 
optimal distribution of subventions. 
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APPENDIX C. VAi;UE OF AM ENTERPRISE AND 
OF AN IKPROVEKENT IN IT 



Let a society^ or some organization within lt« 
spend F dollars a year for some enterprise Mhlch yields a 
benefit (yield) Judged to be Morth Y dollarsj l.e.j of a 
value equal to what Y dollars could buy if used for typical 
other puirposes. In general the dependence of Y on F vlll 
have the form shown in Fig. c.l: at low Fj the enterprise 
will usually be Inefficient; its efficiency will at first 
rise as F Is increased; for large F a region of diminishing 
returns Mill be reached^ and Y will grow more slowly. If 
the enterprise 




Pig. C.l 
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consumes only a small fraction of the funds available to 
the organization! the optimum operating point will be that 
maximizing the distance above the line Y>Fj I.e., the 
point at which dY/5P=!l. Operation at any point between 

and Pg will give a net benefitj however. If the full 
curve never rises above the 4$** line, the enterprise is 
not worth pursuing at all. 

Now consider a hypothetical change in the enterprise. 
Improving its efficiency or productivity. This will change 
the function Y(P), say from the full to the dot-dash curve 
In Pig. C.2. 




Let the optimum operating point (point of unit slope) 
under the old regime be P> that under the new regime P' , 
If the change la smalls the difference In the heights of 

and P above the 45* line can be evaluated either as the 
vertical shift PQ= (6Y)p or as the horizontal shift PKs -(5?)^ 
Often> however> what Is easiest to estimate Is not either 
of these two quantities, but the Increase In yield that 
would result under the new regime If the same professional 
staff were to be used In the new regime as In the old, with 
the same standard of support, l,e,> the same availability of 
supplies, secretarial help> etc.> even though e^endltures 
for these Items might rise In consequence of their working 
mere productively* Let S In the figure be such a hypothetical 
operating point, (Such an estimate Is especially natural 
If tho value of the i3fmovatlon can be ejqpressed In terms o^ 
an equivalent augmentlon In man*hours worked,) In such case' 
the known quantity Is the vertical distance from P to S> and 
the desired net benefit Is this vertical distance minus the 
horizontal distance from P, to S, 

To compute the quantity just mentioned, let us try 
to divide P Into two terms: 

5 those ejqpendltures that depend mainly on the 

amount of useful work done, rather than on the 

number of professionals doing Itj 
P s those ejqpendltures that depend mainly on the 

It 

number of professionals employed, rather than 
on their productivity, ^ 
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Then we have F-F^+Fp, with aY, F^ocsize of professionaOl 
staff. The horizontal distance from P to S In Fi«. C.2 will 
then be« to first order* 

BP^ m F^(S) -F„(P) = F^-f. > 

where B^V ie Y(S) -Y(P). Thus the increase In net benefit 
under the new regime is 

6(Y.P) = 5^Y-5F^ ^ V(^-T^) > V^-r^) " V^' 

since Y>F if the enterprise was worth pursuing In the 
first place. 

Studies of budget items in a typical Industrial 
research and development organization> quoted without 
details In Ref . 28> have Indicated a value for F^ ec^ual to 
about 1.55 times the bare salary budget for professional 
staff. Ve have used this value In the explicit exaoqples 
of Appendix E. As F^ is normally rather less than Fp, the 
Inequality in (C.l) will not be a very strong one unless 
Y/F is considerably above unity. But for enterpriseij where 
the latter is the case one should try to estimate the value 
of Y/F In order to Improve on the lower limit given by the 
far right of (C.l). 
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APPENDIX D, fiXAMPI^ES OP HOW USER-TIME DATA CAN 
BE CONVERTED TO A MEASURE OF BENEFIT 

We shall use the basic assun^tlons described In 
Section 111*4 of the text^ namelyi that on the average 
each user of an Information service allots to Its use the 
amount of time which, for fixed characteristics of the 
environment with which he Interacts, maximizes his productive 
output, and that this productive output has the form of 
Eq* (6), l,e*, 

q^(l-t^-t^)E(t^,t^) , (Da) 

where t^ Is the fraction of his time he devotes to the 
Infonnatlon service in question, t^ Is the fraction of time 
devoted to other not directly productive activities, and E 
Is an efficiency factor* The function tp, which measures the 
output of productive work as a function of the time x directly 
devoted to such work, has the general form shown below: 



V 
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For scientific and highly technical work it has>-* aignificftrit 
upward* curvature, because of the need to have many different 
strands of thought simultaneously in the forefront of 
consciousness, and because of delays attendant on tjxm-on 
and maintenance of apparatus* We have sampled opinions from 
a number of research physicists, for example, which suggest 
that the difference in slope between, say, and x^O*l, 

is probably rather more than a factor of 2, Individual differences 
may be sizable, however* (We shall return to the concept of (p 
at the end of this Appendix*) 

A correct description of the function E should 
take account of a number of effects* To begin with, its 
dependence on t^ Is usually very nonlinear, because the ^ser 
seeks first those pieces of information with the highest . 
anticipated relevance for his work, and then works down to 
less and less promising items as t^ Increases* Moreover, 
In mahy cases Increasing t^ will produce an increasing 
redundance of information, the same piece of knowledge being- 
repeatedly encountered in trivially different forms* A 
further complication has to do with the interaction of 
different information channels: for example, E can be strongly 
Influenced by the amount of time t spent interacting with 
the "grapevine" of Informal contacts; the effectiveness of; 
these contacts. In turn, depends on their interaction with 
written sources of information; etc* To sort out these various 
interrelationships one can make ^use of several types of 
empirical observations, such as: the relative amounts of time 
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that particular types of users choose to spend in the use 
of different types of information resources, including the 
grapevine; the relative frequency of various sequences of 
information-transfer operations in the acquisition of items 
of Information actually found useful; order-of -magnitude 
guesses as to the seriousness of the redundancy and diminishing- 
returns effects* Later below ve shall present, mainly for 

illustrative purposes, some calculations with a rather specific 

29 

model designed to take acoount of these effects* First, 
hotrtever, we shall illustrate a few particularly important 
principles by writing a few equations for a deliberately 
over-simplified model* ' 

Both in our initial over-simplified discussion 
and in the analysis of more sophisticated models, we shall 
restrict attention to two specific types of change in an 
information service: 

(1) A change that will enable each user, on the 
average, to get the same amount of useful 
information from the service in lOOX^ less time* 
(11) A change that will enlarge the supply of 

information from service 1 from which the user 
may select items for perusal or study, under 
the assumption that the additional items, whose 
number is 100?^^ of the original number, have 



ERIC 



92 



the same distribution In quality and 

appropriateness for the user's needs as . 

those originally available. 

In our Initial discussion vte shall make the 
simplification of assuming that vthen either of these types 
of change Is made In a particular Information service i, 
neither the time devoted to use of other liiformation resources, 
nor the amount of useful Information obtained from thmi, 
changes. In such case we can dust take for E some function 
of the general shape shown below, and can Ignore its dependence 
on the other times, such as entering Into t^. 




Fig. D.2 



The optlmallty condition, (7) of the text. Is thus 



V'(l-t.-t^) E'(t^) 



(D.2) 



This already gives us some Information about the form of 
the function E, If t^ and t^ are empirically known «nd if 
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Me can regard 9 as approximately knoMn, (There Is, of 
course, an arbitrariness in the nomallzatlon of the' 
functions <p and E: either could be multiplied by a constant 
and the other divided by the same constant; for our purposes 
MB can leave the normalization unspecified.) If Me have 
further Information about the relative sunounts of useful 
knowledge acquired through channel 1 and through all other 
channels, we can characterize the function E even further, 
since we will know approximately how far the ordinate of the 
present operating point F In the figure lies above the 
Intercept B, 

Consider first, for this simplified model, the 
effect of the time-saving measure described In (1) above. 
Such a measure replaces the function E by a function where 

Case (1): t{t^) = E(tj^+Uj^) , (D.3) 

so that the change In E Is, to first order, 

6E s f-E » ^tj^E' [t^) . (D.4) 

From (D.l) and (D,2) we then have 

Case (1). ^ = ^ = 7,t^ ^ . (D.5) 

Note that we do not need to worry about the change 6t^ that 
will occur In t^^ as a result of the Innovation, because we 
have assumed Y to be stationary with respect; to changes in 
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this being in fact tho origin of Eq* (D.2), Now the 
value of 9'/<P ^ typical research-worker's operating point 
Is likely to be In the range 2 to 3s even If one were to 
Ignore the rather appreciable upward curvature of the plot 
of Pig. D.l, setting <;>ocl-t^-t^, we would still have (p'/v « 
(1-t^-t^)"^, which la typically 1*5 to 2 or more. Thus we 
have our first major conclusion^ which as we shall see below 
remains valid In more sophisticated models; the value of 
a time-saving Innovation Is enhanced over the value of the 
time savedj by an amplification factor of the order of 2 or 3* 
due simply to the form of Qie productivity function 

Now let us turn to the other type of innovation^ 
called (11) above^ namely^ hxi augmentation of the amount of 
information available for perusal or study. The assumption 
enunciated above for this case amounts to replacing E by S 
where 

Case (11): ^'(t^^) « E'(^) . (D.6) 
Thus to first order 

6E'H E'-E' » -Xt^E" , (D.7) 
so that, by Integration 

6E = I^^SE'dt^ « X j^E(t^)-E(o) -t^E'(t^)^ (D.8) 
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The resulting fractional increase in output is thus 

6Y 61? rE-E(o)-t.E'-i . 
Caae (ii). T'^^l g (^'9) 

where ^ is the distance from the intercut B in Fig* Dt2 
to the intercept C of the tangent* UnlUce (D*5)> which 
depended only on the fom of the approximately understood 
function {^*9) depends sensitively on the details of the 
function E; to evaluate the benefit from a type (il) 
innovation one must therefore conduct studies adequate to 
map out a rough shape for E« 

Our discussion so far has neglected two effects^ 
\ one, at leasts of which can be fairly important^ in the 

\ direction of enhancing the benefit of Improvements in 

f Information services* The two effects are: 

(a) Different information channels can nourish 
each other* Inqprovement in a particular 
information service 1 affects the efficiency 
E of a given individual not only via the 
direct route we have been considering (increasing 
the amount of information he can get for a 
given expenditure t^ of his own time)^ but 
also by increasing the amount or value of the 
Information he receives through other channels 
(since the Individuals with whom he interacts 
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In these btfiar ch^umels will themselves 
be better Infomed &s a result of the 
ioprovement In channel !)• 
(b) The tine distribution that Individuals 

choose to niake between use of the literature, 
use of the grapevine, and other activities 
win not In general be such as to cptlnlxe 
the total social yield froa all Individuals 
together, even though each IndlvidusG. undertakes 
. to cptlnlze his owi output. Specifically, an 
Individual Kill not redlstrjlbute his ana tine 
between these various types of activities If, 
such redistribution will not Inprove his own 
output, even though it might inprove the - . , 
output of others. (This statement may be & 
little extreme, but there certainly Is an 
effect of this sort.) ' 

In a study^^ which will not be described In detail 
here, calculations have been made for a few quantitative 
models which embody allowance for these two effect*, and 
for the fact that Information received through different 
channels may be redundant. For a considerable range of 
certain parameters entering these models, t2B following 
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statements seem to hold true: the benefit received from 
a time-saving Innovation In a formal Infomatlon channel 
1 Is enhanced by a further amplification factor, beyond 
that given In (D,5^« due to nourishment of Informal 

^^^^^^^^^^^^^^^^^^^^^ ^^^^^^^^^^^^^ 

by formal channelsj If comparable amounts of Information 
are received through formal and Informal channels, this 
enhancement factor is typically the order of l»5> and 
It Increases slowly with Increase In the relative 
amount received from the Informal channels* The effects 
of . the redistribution of users* time produced by the 
Innovation seem In nearly all cases to be minor * 

In the more sophisticated models the effect of an 
augmentation of available lnfomatlon» case (ll)> continues to 
be rather more model-sensitive than In case (1). The^ effects 
of mutual nourishment of different channels^ and their 
mutual redundancy, may either Increase or decrease the benefit 
In comparison with that given by (D.6)> depending on the 
assumed values of various parameters entering the model. Here 
again> however^ the effects- of readjustment in the distribution 
of users* time are usually minor. 

In closing we shall indicate^ a^aln for an over- 
simplified model, why it is that mutual nourishment of different 
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Information channels produces an amplification of benefit, 
as mentioned In the underlined sentence abovG. Suppose 
Information Is received through two channels, "literature" 
(fraction t^ of time) and "grapevine" (fraction t^), and 
suppose there Is no redundancy, so that 



E(t^, tg) = e^(t^)+ eg(tg) . (D.l6> 



If the Individuals with whom the typical worker Interacts 
In the grapevine are like himself, and get Information from 
similar sources^ It will be reasonable to suppose that' 

eg(tg) - f(tg)E , (D,ll) 

where f Is some Increasing function which tends to saturate for large 
tg, and that each Individual will try to maximise his own eg by 

choosing an appropriate t in f (t ) treating the E of (D.ll) 
as a constant [this Is the source of the effect (b) noted 
above]. From (D.IO) and (D.ll) we have 



and from (D.l), 

Tf = ^ l^f " • • (D.13) 



9(l-t^-t^)e^(t^)^ 



Thus if one Ignores changes In t and t * 



- {^^ ^L\ 
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Since the optimallty condition re t« is 

V 



we have for i=t In case (i)j. by (D.4) with e^ replacing -E, 



5Y /e.+e. 



Which differs from (D.5) by the "mutual -nourishment" 
amplification factor (e,+e_)/e, . What this. means is that 
an innovation saving time in use of the literature meJces 
everyone not only get more information from the literature, 
but also deliver more Informatior. via the grapevine. As 
noted above, allowance .for redundancy decreases the amplification 
effecti typically, if e^ae^,^ the factor (e^^+e^e^wa . - 

In (D.16) becomes about 1*^ In the more sophisticated models. 

The Importance of the function (p{x) of Fig. D.l for 
this analysis suggeBts that it would be worthwhile to give sort e 
attention to techniques for estimating it, and to ways of general- 
ization that has been suggested is based on the conception that 
it is intellectual energy, rather than time, that is the scarce 
commodity, and that time spent In different types of activities 
uses 19 this -energy at different rates. This one might replace the 
9(l-t^-t^) In (D.l) by 9(l-p^t^-p^t^), where is the ratio of' 
the energy demand per unit time while using information resource 
1 to that while doing typical productive work, and is a 
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similar average ratio for the remaining activities. With 
we could write 




where is some function of its argument* Our analysis 
through (D*9) could now be repeated with no change except 
repl^^cement on 9 by X^* But if rates of different channels 
were to be compares^ as in the equations (i)tlO) -(D.I6) for 
"literature" plus "grapevine" channels, one would have to 
take account of the dependence of X^ o^i the channel i. 
Unfortunately, while time spent in _dolng varj-pus types or 
things can be directly measured, expenditures of intellectual 
energy cannot . 
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APPENDIX E. P0SS3IE PROCSDUBES FOR BENEFIT' 
QUANTIFICATION IN TYPICAL SPECIFIC CASES 



The brief discussions belowj for several of the 
Items on the list of Appendix At are intended to show how 
one might go about getting a quantitative value measure. 
Any numbers quoted are only illustrativej and make no pretense 
to authority or correctness; the Important point is rather 
that procedures can be identified by which roughly correct 
nxMbers could be obtained with a little work* Horeoveri 
it must be remembered that the measure of value we are discussing 
here is only one of several factors that enter Into the 
decision on any Item: one must also consider such things 
as costSj economic stability^ and organitational or political 
practicality. The numbers on the Items correspond to those 
of Appendix A. 

1» Replacement of a centralized library by local libraries * 

Various studies^^ have shown that the use 
made of any Information resource decreases rapidly with 
Increasing distance from the user or Inconvenience to 
him. In part this decrease is logicalj since Increase 
in time required will change the optimum division of the 
user's time between use of this resource aii^ other activities 
(see the study^^ briefly summarised In. Appendix U, for an 
attemcpt at mathematical evaluation of this effect) . But 
the observed decrease is so rapid that one must conclude 
that most users at some point fail to optimize their 

♦ 

ifir • • — — — ^ — 



ttma distribution. This introduces a worrisome element 

in'to the process of making dollar calibration from users* 

time studies; further investigations are needed to 

clarify the nature of the misjudgments involved. For 

the present (discussion ve shall assume that such studies 

would show that use of a resource such as a library 

becomes more nearly optimum the less the delay and inconvenience 

involved^ so that increasing delay^ etc,^ leads to 

sub^optlmum use. 

Let us consider* then, that users vtho have a dapartmental 
library in their own building make optimal use of It; the 
T'^actlon t^ of their time vthlch they devote to such use can 
be measured In similar institutions where departmental 
libraries already exist. For our Illustrative calculation, 
vte shall assume t^ = 0,007, & figure that might be reasonable 
for physicists, though too low for chemists. The difference^ 
In commuting time between use of a central library and use 
of the departmental library can be measured: suppose that In 
a given case It amounts to 10 minutes per round trip. The 
average duration of a library visit can also be measured: let 
us assume It to be .50 minutes in the present exercise. Then 
If the users were to optimize their distribution of tine in 
both cases, the shift from the one library system to the other 
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might be treated as a 20^ change In the time required to 
get a given amount of Information from the llbrary-vlslt 
channel [like "case (1)" of Appendix D« hut for a model 
Isolating library visits from other types of literature 
use* Including phoned requests to the library* etc. J. As 
in Appendix D« the effect of this 20^ change vtill be 
equivalent to the value of this time times, an amplification 
factor vthich can be at least roughly computed from obtainable 
inputs* and vthich vte shall teike to be 3. Thus for a physics 
research group> vtith a loading factor 1.55 applied to bare 
salaries to take account of nonproductivity-related expenses 
incurred through employment of p:iX)fessionals (see Appendix C)* 

Excess value received (total 
from departmental % 0.00? X0.2X 3x l*55x staff 
library per year salaries) 

- nfw;(;v (staff ^ (mean 
* -0065 X ^g^^e) ^ salary) 

For a staff of 60 this vtould be about $6000 per year. 

But this is on the assumption that use of the more 
remote library would be optimal, and As noted above, it 
probably falls far below optimal. Values of t^ for groups 
with remote libraries can be obtained! suppose the value of 
tj^ were 0.002. All indications are that the function describing 
the dependence on t^^ of the utility of the information received 
from library use is a rapidly saturating one, similar to the 
E(tj^) of Pig. D.2 in Appendix D. Thus: 
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Fig. E.I- 



The optimum-use point for the central library would be the 

point at wtilch the slope of the dashed curve is the same as 

that of the full curve at m ,007 Mid ml^t correspond to a tj^. only 

slightly smaller . . For a plausible set of para:meters 

(appropriate parameters should of cours« be sought in a special 

study) this new optimum point might have 9^ as much u^tility 

as for the departmental library* as shown. But the actual 

use t^ 5 0.002 might have only 55$S as much utility. In such 

case the dollar value difference between the two library systems 

would be about five times the $6000/year figure quoted above. 

The ^30 K figure would pxobably exceed the total 
annual acquisition cost of a physics library; and certainly 
would far exceed the differential cost of acqiuisitions that 
would need to be duplicated if departmental libraries were set 
yxp. The |6 C figure* on the other hand^ id.ght be of the ieme 
order at the latter. Putting in space and staff expenses^ etc.* 
one could probably derive reasonable criteria for when (in terms 
of size of staff* etc.) individual chemistxy* phynics* mathematics* 
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etc. libraries should be set up* when libraries for several 
departments should be consolidated* etc. 

Our simple discussion here has not taken any account 
of students, a very Important consideration In university 
affairs; they could, of course, be put into the picture with, 
similar techniques, 

8 . Subsidy of translation .journals . 

This could benefit society In two waysi by Increaalng 
the availability of existing translation Journals, and by 
bringing new ones into existence. Here we shall dlacusa only 
the former channel. As in most cases, dollar calibration for 
this problem can be obtained either from market data or from 
user-time studies; as neither approach can be made very accurate. 
It would be best to do one* s best With both approaches and compare 
the results. 

At the moment the needed data are more nearly available 
from the market approach. Let us take as an example a particular 
translation Journal, Soviet Physics JETP, published by the 

l4 

American Institute of Physics. According to the SATCOH study* 
the X968 circulation of this Journal was 161I and Its sub- 
scription cost, per equivalent klloword of text, 3*^^* Vront 
the general trend of cost-circulation statistics for many 
physics Joumala (Bef,l4, Fig. 7) it can be estimated that if 
the Journal could be marketed at near run-off cost (about 
0,3-0,5^ per equivalent klloword, according to Pig. 11 of 
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B6f.l4) it would. In the q:ua8i-steady state, have about 2900 

aubscribers. The Increase In area under the demand curve — see Fig* 

Bl (b) above -* would be roughly that of the triangle of 

height 1200 andwidth 3^/klloword,- or $l8 per kiloword. This, 

then, is an estimate of the benefit society in general (jjicludlng 

foreign -ewmtries) would receive if support of prenw costs 

by subsidy were to make it possible to market this Journal 

at run*off cost. This is a minor, though appreciable, fraction 

of the total prerun cost (presumably about $45 per kiloword, 

the eiqpense of translation being compensated by the saving In 

photo-copying equations, etc.), i.e., of the amount of subsidy 

that would be Involved. Thus society would be getting a 63/^5 

return on its subsidy money. 

As the $18 figure Just estimated could be In error 

by a factor of two In either direction because of the uncertainty 

In the elasticity of the danand curve, and because the market 

approach has. other shortcomings, studies aimed at dollar 

calibration via users' time would be worth performing* Seducing 

the subscription price to the run-off level would have two 

kinds of effect: it would make the Journal available In 
Institutions where it is not now available, and it would make 

it more easily available In other Institutions via sub-libraries. 

Individual subscriptions, etc. In the former case th« effect 

would be like that of "case (li)" of Appendix D and the 

contribution to the value could be estimated by the methods 
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described there. If market data on the number of new Institutions., 

eubscrlblng could be obtained. In the latter (probably more 

ijmtortant) case the effect vtoiild be roughly one of decreasing 

the time Involved In use of the translation Journal, and could 

be estimated If data could be collected on the amounts of time 

spent in use of this Journal (as compared, say, with a more 

widely available one like Physical Review) In institutions 

having it in many sub-libraries and in those having it only 

in a central library; the mathematical techniques would be 

similar to those of Appendix D and Ref. 29* 

9 • Adoption of a larger page format by a .journal . 



to get a measure of value. With two groups of subjects one 
could compare reading time required for a given level of 
comprehension with, say, a 500-word Journal page and a 1300-word 
page. For literature with many equations and figures, the 
reduction of the need to leaf back and forth to connect these 
should lead to quite a measurable difference in efficiency. 
While we do not know how much difference In speed of comprehension 
would be found in such a study, the fact that differences In 
typography are Known to affect reading speed for non-technical 
material by 10^ or even 20i^^ suggests that a 10^ figure might well 




This issue is a particularly simple one for which 




be found for the present case. If so, the value could be 
computed by the methods of Appendix D, "case (l)", i,e.. 



(Mean time spent 
by all users in 



(Ampllfi- 



Value « 0,1 reading given x 
Journal) 



(Mean 
salary) 



cation 
X l,55x factor 

of 3 or so) 
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where the factor 1.55 takes account of loading as described 
above and In Appendix C, and the last factor Is due to the 
Increase of efficiency with increasing time worked and to 
feedback effects, as discussed above and In Appendix D. 

11. Support of citation indexes . 

Let us consider the special case of a citation index 

for chemistiy, st^posed in existence but very costly. Should 

such an index be operated on a self- supporting basis by sale 

of subscriptions, or should it. be socially subsidized, so that 

it can be marketed at something approaching run^off cost? 

Here again one could in principle use either a demand-curve 

or a user-ttme approach; however, statistics on the demand curves 

for citation indexes are almost non-existent, so our remarks 

here will be concerned only with the user-time approach. 

According to some statistics collected by a committee 

of the American Chemical Society,'^^ industrial research chemliBts 
who have access to the Science Citation Index spend an average 
of about 0.2 houra per week using it. [ One can question 
the methodology used in collecting these statistics —.a 
more controlled study is needed if such figures are to be used 
for an Important application. Also, the data are doubtless 
not representative of steady-state user ^ud©Bents, as sCI la 
still new to many potential users.] But only So)< of the chemists 
queried had such access. From tt^e nature of the sample it 
seems likely that most of the remaining Qo^ would have found 
SCI cosqparably useful if they had had it; statistics on ch«aical 
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publications, patents, etc., from different kinds of Institutions 
could probably be collected Mhlch Mould give an estimate, or 
at least a decent lower limit, for the effective nomber of 
chemists Mho do not noM have access to SCI but who could benefit 
comparably from It. To combine with such data one would need 
only to Know the dollar value of the loss, per chemist, that 
the average present user of SCI would suffer If he were 
deprived of it. 

In a crude model, one could Ignore the "gr^evlne" 
effects discussed in Appendix D« and simply looK at this average 
chanlst as an individual. The benefit he receives from spending 
a fraction t^ of his time with SCI will depend on t^ according 
to a saturating curve of the torn of Fig. D.2 of Appendix D, 

1 « 6 « ^ 
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If he uses good judguent, he viii plcK his operating point P 
to be such that the slope of this curve represents the marginal 
value of his time when devoted to other uses. Since t^ is 
very small (% 0,2/i\0 ■ .005 in the present example), this marginal 
value can be taken as unaffected by t^; In such case the net 
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1008 to him If Is deprived of SOX will be the dlst^inpe BC. 
TO get a numerical value for this one must knoif something 
about the curvature of the curve. A rou^ guess iKntld set 
BC % the vertical distance from ^ to P; this would be the case 
If the curve were parabolic with a slope at A much greater tl^an 
that at P. Better guides to the shi^e of the curve could be 
obtained from studies of search yields vs. time (see for 
exanqpie Sef.6Q), time spent with SCI when It Is Inconveniently 
available, etc. (Another estimate, though probably not a very 
reliable one, can be obtained from the estimate In Sef . 15 that 
the average user of SCI saved 0.4 hours/week by such use; 
this means BC « twice the vertical distance from C to P. ) 

With the above guess BC % vertical CP« the value 
.005 for t^, and the slope CP % 2.0 X 1.55 X $15K/man yr. 
as estimated from the dlscusslm of the 9 function In Appendix 
T>, one would get a value of about $230 per chemist' 
year, resulting from supplying him with a citation Index. One ■ 
would need to combine such a figure, suitably 8hazi>6ned> with 
an estimate of the number of chsmlsts In the country, not 
now able to use SCI, whose use patterns ml^t be cOB]farab1e 
with those of the ACS sample. One should also check the 
assumption that nearly all of these would Indeed have access 
to a citation Index marketed at near run-off cost. 

It Is noteworthy that the benefit figure just estimated 
Is so large that, even If It Is an overestimate by a factor 
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three, any c(Mnpany with more than 30 or 35 research-level 
chemists should purchase SCI at its current price of about 
♦2500 a year. As the great majority of the chemists in the 
ACS study were employed by companies with over $100 million 
annual sales, while only 20^ of them had access to SCI, a serious 
hysteresis In market response Is indicated. 
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